-- Logs begin at Wed 2022-05-25 13:54:07 UTC, end at Wed 2022-05-25 15:51:43 UTC. -- May 25 14:37:59.411912 dv-cinder-787296-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 14:37:59.423158 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:37:59 2022] *** May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: nodename: dv-cinder-787296-9-iscsi May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: machine: x86_64 May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: clock source: unix May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: pcre jit disabled May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: detected number of CPU cores: 4 May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: current working directory: / May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: detected binary path: /usr/bin/uwsgi-core May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: your processes number limit is 47680 May 25 14:37:59.425145 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: your memory page size is 4096 bytes May 25 14:37:59.425825 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: detected max file descriptor number: 2048 May 25 14:37:59.425825 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: lock engine: pthread robust mutexes May 25 14:37:59.425825 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: thunder lock: enabled May 25 14:37:59.425825 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 14:37:59.425825 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:37:59.469567 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: Python main interpreter initialized at 0x558fdb28d9c0 May 25 14:37:59.469567 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: python threads support enabled May 25 14:37:59.469567 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: your server socket listen backlog is limited to 100 connections May 25 14:37:59.469567 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: your mercy for graceful operations on workers is 90 seconds May 25 14:37:59.469902 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:37:59.469970 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: *** Operational MODE: preforking *** May 25 14:37:59.470290 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: *** uWSGI is running in multiple interpreter mode *** May 25 14:37:59.470290 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: spawned uWSGI master process (pid: 86811) May 25 14:37:59.470489 dv-cinder-787296-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 14:37:59.471544 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: spawned uWSGI worker 1 (pid: 86822, cores: 1) May 25 14:37:59.471544 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: spawned uWSGI worker 2 (pid: 86823, cores: 1) May 25 14:37:59.471544 dv-cinder-787296-9-iscsi devstack@keystone.service[86811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:38:05.161739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:38:05.161739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: from cryptography.utils import int_from_bytes May 25 14:38:05.162540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:38:05.162540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: from cryptography.utils import int_from_bytes May 25 14:38:05.208564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:38:05.208564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: from cryptography.utils import int_from_bytes May 25 14:38:05.209132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:38:05.209132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: from cryptography.utils import int_from_bytes May 25 14:38:05.211029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:38:05.211225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:38:05.211417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] command line args: [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:38:05.211684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:38:05.211863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ================================================================================ {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:38:05.212115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] admin_token = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.212362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] config_dir = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.212548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.212759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] config_source = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.212943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] debug = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.213211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_config_append = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_dir = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_file = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.216797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.217023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.217241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.217411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.217598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.217835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.218071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.218305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.218538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.218785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.219029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.219300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.219790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.219974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] publish_errors = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.220205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.220436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.220632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.220894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.221129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.221366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] standard_threads = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.221597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.221838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] use_journal = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] use_json = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] use_stderr = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] use_syslog = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.222948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.223208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.223446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.223705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.223945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.224193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.224433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.224704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.224943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.225191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.225440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.225691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.225926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.226172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.226410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.226656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.226903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.227140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.227394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.227648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.227893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.228129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.228382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.228660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.228915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.229162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.229394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.229625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.229902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.230409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.230575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.230832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.231067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.231305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.231555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.231802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.232035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.232286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.232518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.232779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.233018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.233250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.233481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.233711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.233941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.234177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.234425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.234657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.234895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.235623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.235623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.235623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.235801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.236035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.236270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.236507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.236768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.237007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.237243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.237475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.237722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.237957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.238195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.238427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.238688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.238925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.239158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.239394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.239630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.239899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.240137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.240387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.240644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.240887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.241123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.241360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.241607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.241845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.242081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.242323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.242560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.242797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.243031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.243267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.243503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.243763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.244000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.244241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.244477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.244740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.244979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.245213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.245520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.246932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.247168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.247415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.247652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.247907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.248163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.248404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.248652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.external = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.248887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.249182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.249414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.249647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.password = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.249878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] auth.token = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.250120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.250356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.250602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.250840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.251085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.251331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.251568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.251804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.252051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.252299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.252545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.252805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.253047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.253284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.253534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.253785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.254020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.254271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.254551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.254798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.255060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.255301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.255558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.255790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.256010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:38:05.256113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.256209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:38:05.256285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.256400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] command line args: [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:38:05.256485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.256741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:38:05.256847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.256932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ================================================================================ {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:38:05.257007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.257165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] admin_token = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.257256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.257398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] config_dir = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.257479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.257596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.257681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.257755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] config_source = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.257894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.257991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] debug = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.258126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.258241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.258367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.258448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.258548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.258627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.258809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.258890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.259059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.259138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.259291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.259368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.259470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_config_append = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.259549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.259649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.259759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.259846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_dir = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.259991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.260082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_file = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.260228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.260307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.260475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.260555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.260742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.260837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.260975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.261592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.261702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.261914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.262158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.262247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.262312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.262372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.262444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.262517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.262598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.262716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.262797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.262918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.263026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.263165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.263255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.263435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.263523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.263676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.263756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.263913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.264003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.264143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.264380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.264467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.264634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.264734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] publish_errors = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.264872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.264953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.265104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.265187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.265285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.265449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.265530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.265733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.265813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.265976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] standard_threads = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.266054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.266209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.266291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.266453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.266532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.266631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.266794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.266886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] use_journal = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.266960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] use_json = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.267073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.267160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] use_stderr = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.267301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] use_syslog = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.267388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.267533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:38:05.267614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.267792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.267871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.268923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.269838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.270984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.271980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.272999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.273980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.274915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.275930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.276687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.277454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.277678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.277810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.277938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.278960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.279977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.280914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.281943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.282953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.283954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] role.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] role.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.284887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.285922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.286947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.287973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.288908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.289963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.290914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.291968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.292882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.293886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.external = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.password = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.294978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] auth.token = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.295940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.connection = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.296864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.297915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.298877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.299986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.300955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.301089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.301172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:38:05.301340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.301591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.301837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.302091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.302333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.302589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.302830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.303089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.303329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.303579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.303817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.304067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.304317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.304555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.304816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.305068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.305303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.305543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.305794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.306048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.306284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.306519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.306753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.307001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.307249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.307499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.307756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.308036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.308345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.308345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.308896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.309134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.309376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.309615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.309862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.310108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.310354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.310605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.310839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.311091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.311339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.311579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.311828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.312079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.312383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.312808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.313070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.313536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.313803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.314270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.314537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.315000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.315276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.315763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.316021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.316555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.316880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.317371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.317636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.318096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.318358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.318799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.319068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.319562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.319823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.320297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.320571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.321070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.321334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.321760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.322022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.322477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.322741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.323187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.323449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.324293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.324806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.325071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.325488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.325807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.326064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.326311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.326555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.326797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.327038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.327291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.327543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.327785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.328042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.328278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.328527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.328792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.329032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.329274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.329525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.329780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.330024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.330265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.330508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.330762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.331013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.331252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.331505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.331758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.331997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.332246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.332335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.332487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.332577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.332763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.332867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.333008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] role.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.333258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] role.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.333493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.333748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.334001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.334252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.334502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.334752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.335001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.335250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.335501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.335736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.335985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.336233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.336481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.336754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.337163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.337405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.337659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.337910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.338159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.338411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.338650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.338915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.339171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.340029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.340339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.340575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.340833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.341092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.341348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.341601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.341844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.341969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.342101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.342308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.342549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.342790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.343040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.343279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.343537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.343787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.344026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.344270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.344515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.344789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.345032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.345273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.345511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.345759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.346009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.346242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.346487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.346785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.347060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.connection = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.347308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.347560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.347803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.348058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.348301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.348543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.348809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.349050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.349299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.349540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.349789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.350031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.350280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.350520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.350767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.351000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.351245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.351484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:38:05.351656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:38:05.369818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.370045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.376392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.376646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.376877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.387592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.406919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.407151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.423315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.445799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.474891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.475125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.483570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.483808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.540893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.541984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.542077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.542243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.566930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.567023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.567149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.567232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.567366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.567450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.578831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.579160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.591998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.592929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.593576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:38:05.611130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.611346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:38:05.611444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.611559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:38:05.611685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.611890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:38:05.611981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:38:05.612238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.612973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.613055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.613227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.624846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.625126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.625402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.625724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.626506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.626786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.627062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.627346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.633796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.635449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.637772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.638058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.638340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.638621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.638898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.639155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.639491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.639584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.639772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.639856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.640874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.641255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.641532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.641811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.642088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.642359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.666724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.668780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.669060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.669189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.670908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.671191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.674317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.674552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.674825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.676444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.676748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.677031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.682067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.682347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.684821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.685105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.687327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.687723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.688006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.688288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.688562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.688860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.689128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.689390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.689556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.689955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.690240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.690525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.690806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.691086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.691360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.691631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.707863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.708140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.710348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.710630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.712792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.715818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.716961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.717257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.719474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.719771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.722276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.725008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.725842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.728649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.729585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.730487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.730737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.731031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.731308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.731589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.733030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.733330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.733622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.733915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.734197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.734492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.750746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.751026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.751292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.751554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.755738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.756029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.756297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.756561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.759563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.762307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.762585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.764774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.765652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.765932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.766212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.766498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.766575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.766768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.766839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.770028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.770318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.770601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.771045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.771172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.780852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.781136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.781415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.781700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.781981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.782262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.782544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.786167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.786524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.786880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.787238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.787605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.787953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.788338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.801315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.804530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.807533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.807853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.809515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.811103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.811208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.811390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.811670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.814688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.816352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.818070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.818356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.818648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.819008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.820601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.824711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.824947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.825233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.825507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.826661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.828277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.831518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.831810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.832096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.832382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.834508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.834796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.835175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.842376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.842668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.843060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.843779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.844058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.844340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.844632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.844908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.845193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.845482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.845752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.846019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.846293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.846560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.846819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.847102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.847358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.851053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:38:05.851332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.851615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.851895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.852175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.852459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.852764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.853051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.853322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.853602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.853879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.854150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.854481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.854758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:38:05.888046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fdb28d9c0 pid: 86822 (default app) May 25 14:38:05.891418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072783-f54d-4e20-98f2-317f3c667ccf None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:05.891713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072783-f54d-4e20-98f2-317f3c667ccf None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:05.891995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072783-f54d-4e20-98f2-317f3c667ccf None None] PATH_INFO: `/v3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:05.895837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fdb28d9c0 pid: 86823 (default app) May 25 14:38:05.896312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Wed May 25 14:38:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:14.856383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311537-8403-4e77-abc0-3e6643190622 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:14.856982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311537-8403-4e77-abc0-3e6643190622 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:14.857142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311537-8403-4e77-abc0-3e6643190622 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:14.861652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:14.866969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:14.867396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:14.867527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:14.936811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: INFO dbcounter [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] Registered counter for database keystone May 25 14:38:14.958501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:38:14.964648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writer thread running {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:38:15.153824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG passlib.handlers.bcrypt [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86822) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:38:15.154263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG passlib.handlers.bcrypt [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86822) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:38:15.210243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:15.211853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:15.337156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 14:38:15.538048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311537-8403-4e77-abc0-3e6643190622 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:15.608822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: INFO dbcounter [None req-97311537-8403-4e77-abc0-3e6643190622 None None] Registered counter for database keystone May 25 14:38:15.628290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG oslo_db.sqlalchemy.engines [None req-97311537-8403-4e77-abc0-3e6643190622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:38:15.634430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writer thread running {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:38:15.757026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311537-8403-4e77-abc0-3e6643190622 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:15.761353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:15.762064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:15.763063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:15.763446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:15.771597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:15.823591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:38:15.823884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28128f96-747d-4951-8a50-4c0fa5c2a839 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:15.834635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Wed May 25 14:38:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:38:15.840986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:15.855316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7637712-d897-4d70-a929-7062dda558a5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:15.859828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:15.860988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:15.861281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:15.861561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] PATH_INFO: `/v3/projects/0561c92c72f64ee9b67355671c55b3d1` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:15.863094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] RBAC: Authorizing `identity:get_project(project_id=0561c92c72f64ee9b67355671c55b3d1)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:16.023310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:38:16.023965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b634-7dd1-4b00-8a65-cfd606beaf0b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:16.028407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Wed May 25 14:38:15 2022] GET /identity/v3/projects/0561c92c72f64ee9b67355671c55b3d1 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:18.204803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341412-8c59-4b27-94f1-93f13c736cd9 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:18.205344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341412-8c59-4b27-94f1-93f13c736cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:18.205344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341412-8c59-4b27-94f1-93f13c736cd9 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:18.209445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:18.214841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:18.215597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:18.215959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:18.241722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:18.243277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:18.253410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:38:18.275692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341412-8c59-4b27-94f1-93f13c736cd9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:18.287961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341412-8c59-4b27-94f1-93f13c736cd9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:18.292169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:18.292834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:18.294099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:18.294442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:18.302142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:18.303912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf539e-4b29-4239-a6e7-565a95f4821b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:18.313491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Wed May 25 14:38:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:38:18.318905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:18.328072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084f6a-80a4-4739-bdf2-eb332a1d36c0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:18.332524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:18.333418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:18.333708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:18.333991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:18.335379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:18.337242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4fb23-8932-4b97-8f62-1b422180abd9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:18.338809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Wed May 25 14:38:18 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:20.643613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361fb76-8e5a-4216-a344-97488c74b150 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:20.644140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361fb76-8e5a-4216-a344-97488c74b150 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:20.644235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361fb76-8e5a-4216-a344-97488c74b150 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:20.645557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:20.650725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e734f0-d56a-437a-9477-ae812ef47db9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:20.651159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e734f0-d56a-437a-9477-ae812ef47db9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:20.651302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e734f0-d56a-437a-9477-ae812ef47db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:20.667811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f1e734f0-d56a-437a-9477-ae812ef47db9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:20.669977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f1e734f0-d56a-437a-9477-ae812ef47db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:20.750141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:20.751236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff951c-1552-4740-a867-9549d5dfe3ee None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:20.751533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff951c-1552-4740-a867-9549d5dfe3ee None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:20.751817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff951c-1552-4740-a867-9549d5dfe3ee None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:20.753189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 6/12] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:20.758295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:20.758598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:20.758888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:20.772993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff951c-1552-4740-a867-9549d5dfe3ee None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:20.775826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:20.777068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:20.796587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:20.849457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:20.873001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:20.954818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff951c-1552-4740-a867-9549d5dfe3ee None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:20.986948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960552-a6e3-49ae-914c-72c317737ec3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:20.987752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:20.988561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:20.988884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:20.989175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.000998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:21.013130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:21.014075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:21.014890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:21.024573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.025258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.025549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.025828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.028161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.049705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.087884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.098815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.100327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.166247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c822327-2645-46a5-b96b-5141d429b50a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.201199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.201880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.202169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.202451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.203208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:21.203519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.204981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.206389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:21.212023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.218123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 8/16] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:21.223457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.267131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.319863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.321828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432ce9-c666-4a7c-b837-22b54d302027 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.325795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee094-3366-49d4-9d5f-b97f646f81c1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.354344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.355140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.355429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.356391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.359234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.360107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.360413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.360727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.362353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.363808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.365464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:21.367792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.369328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.370782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:38:21.392107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:21.393162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:21.394160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:38:21.394160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:38:21.394160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:38:21.394160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:21.394160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:21.399907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.490792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7817-13f5-4487-85b9-a94378567e87 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.499587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db3d9-d88d-4ad4-a7d7-13408ae2a988 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.502093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.524224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.525051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.525338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.525625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.526884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.528900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.530643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:21.534301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.535189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.535900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.536356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:21.536541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.537778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:21.538169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.539651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbb804-14ab-48bb-bf72-a62889f8e460 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.558451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:21.568411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:21.644726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a29c4-05a0-46de-867c-aa3f5464400f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:21.681677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:21.682355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:21.682671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:21.682953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:21.684363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.domain.id=default, user.id=1f293424a3574c11b9a214ef1e03ad05) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:21.684789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:21.686281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f47f7b-8447-4310-8cfd-e345c04a93e7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:21.695401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Wed May 25 14:38:21 2022] GET /identity/v3/role_assignments?user.id=1f293424a3574c11b9a214ef1e03ad05&scope.domain.id=default&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:24.564427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e234e-1402-4994-8237-5377f49a2486 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:24.565427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e234e-1402-4994-8237-5377f49a2486 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:24.565917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e234e-1402-4994-8237-5377f49a2486 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:24.567473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:24.577572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:24.578487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:24.578958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:24.609554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG passlib.handlers.bcrypt [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86823) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:38:24.610349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG passlib.handlers.bcrypt [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86823) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:38:24.666029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:24.668385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1b45d2ae-aa13-49e0-aac5-53519bbc835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:24.781022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:24.784308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67759c-9e9c-47f3-ad3f-5a265f645cd7 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:24.784833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67759c-9e9c-47f3-ad3f-5a265f645cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:24.785327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67759c-9e9c-47f3-ad3f-5a265f645cd7 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:24.787125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:24.792347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d441-ce18-459b-8532-166e032bbf84 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:24.792664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d441-ce18-459b-8532-166e032bbf84 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:24.793796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d441-ce18-459b-8532-166e032bbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:24.813873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67759c-9e9c-47f3-ad3f-5a265f645cd7 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:24.937793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b065d441-ce18-459b-8532-166e032bbf84 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:24.939241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b065d441-ce18-459b-8532-166e032bbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:24.981699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.006072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67759c-9e9c-47f3-ad3f-5a265f645cd7 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.043817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:25.045365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae661df-9e76-4639-9e4a-d12b9ff9268a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.045484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae661df-9e76-4639-9e4a-d12b9ff9268a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.045966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae661df-9e76-4639-9e4a-d12b9ff9268a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.047760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 14/26] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:25.053242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.053742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.054027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.054408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.054978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.055343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.055702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.085538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.087305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.088834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:25.091961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:38:25.117374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:25.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:25.119032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:38:25.119032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:38:25.119032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:38:25.119032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:25.126101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 13/27] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:25.127097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.159202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.226064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:25.227113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.248703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c9edb-717f-48ee-abeb-d100c8dab123 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.287017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.287818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.288110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.288393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.300676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-58784e1b-5961-43df-a36f-661620f47ba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:25.310252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:25.311103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:25.311858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 14/29] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:25.312717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db6868-49d1-4638-8bfe-01704b60689d None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.313144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db6868-49d1-4638-8bfe-01704b60689d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.313587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db6868-49d1-4638-8bfe-01704b60689d None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.314973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 15/30] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:25.316173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990334c3-0dcc-49b1-8c23-810edc8f141e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.316620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990334c3-0dcc-49b1-8c23-810edc8f141e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.317043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990334c3-0dcc-49b1-8c23-810edc8f141e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.318367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 16/31] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:25.319173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990334c3-0dcc-49b1-8c23-810edc8f141e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.330417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.345982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a9cb4-8253-4b4b-87e9-115237ce736c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.383940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.384642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.384934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.385216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.385960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:25.386271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.388475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.402767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.410112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:25.411112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.434700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990334c3-0dcc-49b1-8c23-810edc8f141e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.471728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.472741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.473171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.473587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.474582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.476266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.513468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea940a-a093-4927-84b9-0aaa6dfb4fbb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.550074 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.550754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.551037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.551469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.552118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:25.552434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.553906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6b83-99dd-42d9-9902-bff41760a6a3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.562358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 17/33] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:25.563608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabb19-216c-49fe-add4-64f341296f91 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.564479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabb19-216c-49fe-add4-64f341296f91 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.564479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabb19-216c-49fe-add4-64f341296f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.582092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8fdabb19-216c-49fe-add4-64f341296f91 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:25.583291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8fdabb19-216c-49fe-add4-64f341296f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:25.585519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.651335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 18/34] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:25.652886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.653337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.653676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.672732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:25.673924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:25.682253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 17/35] 10.222.0.57 () {60 vars in 1131 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/roles => generated 225 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:25.684146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.765464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 19/36] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:25.766091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:25.845893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd403ac-185b-4b4e-83da-2ede30449144 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.863493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.889735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.890537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.890836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.891126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.891855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.893567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.898778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:25.913186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7574f-aea2-4bac-bdbd-8f74fd1b6f7b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:25.951925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:25.952581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:25.952914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:25.953194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:25.954746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:25.956193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:25.957865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 20/37] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:25 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:25.958615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.029440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 18/38] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/projects => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:26.030717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.087928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5f5e3-130b-4423-914e-29429082d4a1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.128233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.129290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.129773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.130244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.131211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.132894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bd5b6-6ec3-4e80-8971-c7bad9f07572 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.140996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:26.161937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a52b-1d85-4304-842d-916d462f44f3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.200667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.201377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.201673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.201960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.202741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.204176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.292370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1131 bytes} [Wed May 25 14:38:26 2022] POST /identity/v3/roles => generated 219 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:26.292370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.340961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1131 bytes} [Wed May 25 14:38:25 2022] POST /identity/v3/roles => generated 223 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:26.342552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f32a7-8eed-4743-a42a-a3c0135eac4b None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.342850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f32a7-8eed-4743-a42a-a3c0135eac4b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.343139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f32a7-8eed-4743-a42a-a3c0135eac4b None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.344733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 22/41] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:26.350676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.350972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.351269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.357970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:26.370599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:26.372880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:26.438258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02637a6-bcab-4785-8a44-c13980e591f8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.469086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:26.489171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.489822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.490812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.491254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.491972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.498598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.498598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.503305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 20/43] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:26.504668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.632548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915a7f-99c7-4105-bfc5-e387aa4c9082 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.649454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487681-0a9e-48fe-adf3-b9f6719e3227 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.661448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:26.666020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:26.670941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.671746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.672042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.676337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.676337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.676337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.676744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 24/44] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:26.682081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:26.687585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.688457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.688788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.689074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] PATH_INFO: `/v3/domains/default/users/1f293424a3574c11b9a214ef1e03ad05/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.691080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1f293424a3574c11b9a214ef1e03ad05, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.692592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098896-5671-4c46-b121-6c6ba97ba0fc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.757323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 21/45] 10.222.0.57 () {58 vars in 1361 bytes} [Wed May 25 14:38:26 2022] PUT /identity/v3/domains/default/users/1f293424a3574c11b9a214ef1e03ad05/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:38:26.784921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7ee97-cec8-4bd4-ba30-af615d8b86b4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:26.821533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:26.822228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:26.822521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:26.822805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:26.823550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:26.825824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaac8b-cc26-4d53-817d-ac15e867861e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:26.927303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 25/46] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:38:26 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:28.960508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47a0c-5954-49dc-9327-073ff77c4ee8 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:28.961069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47a0c-5954-49dc-9327-073ff77c4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:28.961151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47a0c-5954-49dc-9327-073ff77c4ee8 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:28.962537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 22/47] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:28.969364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d9d9-9d95-4b33-b298-8c6c12d46a8e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:28.969878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d9d9-9d95-4b33-b298-8c6c12d46a8e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:28.970066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883d9d9-9d95-4b33-b298-8c6c12d46a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:28.987475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b883d9d9-9d95-4b33-b298-8c6c12d46a8e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:28.988696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b883d9d9-9d95-4b33-b298-8c6c12d46a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:29.030810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:29.054445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:29.078490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db47a0c-5954-49dc-9327-073ff77c4ee8 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.153111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddcb66-4e96-4587-8179-d7d0c1bc99e0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.153406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddcb66-4e96-4587-8179-d7d0c1bc99e0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.153697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddcb66-4e96-4587-8179-d7d0c1bc99e0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.155134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 27/49] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:29.160334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.160656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.160952 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.178096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:29.179302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:29.188306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db47a0c-5954-49dc-9327-073ff77c4ee8 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.221803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.222534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.222821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.223097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.234315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:29.241931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:29.242880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:29.243632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 23/50] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:29.248818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.249245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 28/51] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:29.272011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.283748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:29.348597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d4e48-95a4-4c01-b515-d13405a9ca40 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.370901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4cf2-2132-4c5f-98f5-9c9b3e7bca68 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.378140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:29.382548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.383225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.383522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.383810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.384649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:29.384977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.386960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.398307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 24/52] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:29.404564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.406549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.407547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.408103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.408796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.409984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.411439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.413099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 29/53] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:29.418647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.500235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:29.503896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7559be-2639-4e71-9cc3-6ee0e9e098a0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.519434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e149e-151b-40ac-b02b-f6c6718b5101 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.538352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.539240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.539531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.539816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.541050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.542521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.544537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 25/54] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:29.550341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.554872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.555544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.555837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.556121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.556874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.558411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.646953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eea7-d741-4704-a136-9ea833568668 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.660802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 30/55] 10.222.0.57 () {60 vars in 1140 bytes} [Wed May 25 14:38:29 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:29.682554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.683728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.684032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.684380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.685663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.687174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e0ee-584b-44c1-b2f2-f5ba462badce None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.689130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 26/56] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:29.695006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:29.726454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:29.806384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f538b-65ff-4009-a21d-c4bb3b068bbb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:29.844023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:29.844723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:29.845015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:29.845299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:29.846148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.domain.id=default, user.id=1f293424a3574c11b9a214ef1e03ad05) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:29.846468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:29.847919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875390aa-4e8c-4f75-82e4-acccf39a0053 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:29.854588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 31/57] 10.222.0.57 () {56 vars in 1322 bytes} [Wed May 25 14:38:29 2022] GET /identity/v3/role_assignments?user.id=1f293424a3574c11b9a214ef1e03ad05&scope.domain.id=default&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:31.910021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c6d1-f092-4e4f-aea8-b9f18f2b6268 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:31.910550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c6d1-f092-4e4f-aea8-b9f18f2b6268 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:31.910659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c6d1-f092-4e4f-aea8-b9f18f2b6268 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:31.911974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 27/58] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:31.917108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:31.917514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:31.918230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:31.935188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:31.936382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:32.000739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:32.024177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c6d1-f092-4e4f-aea8-b9f18f2b6268 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:32.059509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:32.124672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c6d1-f092-4e4f-aea8-b9f18f2b6268 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:32.157803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:32.158602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:32.158894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:32.159177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:32.160404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:32.161836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37d86e-e155-4887-be3b-fee29d20c4ea None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:32.163446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 28/60] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:32.169958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:32.190383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:32.270045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6462e9-92a1-4cae-b8c6-2425cf241e9c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:32.304169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:32.304871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:32.305165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:32.305450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:32.306161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:32.307611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763f00e-de72-4166-bbc8-7bcf469ec8ee None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:32.396075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 33/61] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:32 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:35.662143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1e61-6c1d-438a-a520-f430a4d818c5 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:35.663148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1e61-6c1d-438a-a520-f430a4d818c5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:35.663633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1e61-6c1d-438a-a520-f430a4d818c5 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:35.665468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 29/62] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:35.678188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fae52-0256-4532-8d46-27e9dc96d410 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:35.679121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fae52-0256-4532-8d46-27e9dc96d410 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:35.679610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fae52-0256-4532-8d46-27e9dc96d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:35.705652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-990fae52-0256-4532-8d46-27e9dc96d410 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:35.707175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-990fae52-0256-4532-8d46-27e9dc96d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:35.798547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 34/63] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:35.846257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1e61-6c1d-438a-a520-f430a4d818c5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:35.910503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7322-db6e-4e6c-b2fc-fd7c0cda8433 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:35.910503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7322-db6e-4e6c-b2fc-fd7c0cda8433 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:35.910503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7322-db6e-4e6c-b2fc-fd7c0cda8433 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:35.910503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 35/64] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:35.917014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:35.917956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:35.918693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:35.939251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:35.951280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:35.952487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:35.980755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1e61-6c1d-438a-a520-f430a4d818c5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:35.984988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.056467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.057318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.057605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.057885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.079571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:36.089260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:36.090162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:36.090917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 30/65] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:36.095188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 36/66] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:36.096457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.131077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.207406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca27629-b8bc-486e-abb1-ce68c961ce1f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.254675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.255365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.255658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.255943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.256719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:36.258536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:36.259960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3193a2-d8ff-4d09-80ff-6671cbbee7e8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:36.269976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 31/67] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:36.271549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4b9e7-c3be-40d3-8b5f-aac0294a838b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.271850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4b9e7-c3be-40d3-8b5f-aac0294a838b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.272135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4b9e7-c3be-40d3-8b5f-aac0294a838b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.273390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 32/68] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:36.274884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074217-b6cd-49cc-8d18-84f6b51721f0 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.275253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074217-b6cd-49cc-8d18-84f6b51721f0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.275608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074217-b6cd-49cc-8d18-84f6b51721f0 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.277280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 33/69] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:36.278029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074217-b6cd-49cc-8d18-84f6b51721f0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.307500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.328528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8450-07e1-40e6-9e29-cee36192811c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.365326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.366129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.366421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.366701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.370116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.380239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-54ae2f84-8425-4e1c-9d15-9ad08c9b51e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:36.388544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:36.389624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:36.390412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 37/70] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:36.391834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.391834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.391834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.404677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074217-b6cd-49cc-8d18-84f6b51721f0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.408774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:36.409959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:36.441384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.442271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.442568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.442856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.457132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:36.458661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee42d4-375f-43fa-a0e6-247a3f9cc8cc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:36.464742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 34/71] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:36.464742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.464742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.464742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.478430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:36.480483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:36.486137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 38/72] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:36.486997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.551371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 35/73] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:36.552289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.566296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.600085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb11c-df27-4de2-95fc-9429a8a9519f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.632369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.643983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.645418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.645418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.645688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.646457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:36.646783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:36.648199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3d37c-1500-49b5-b7a4-9fde4ce418c0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:36.658187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 39/74] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:36.659390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464b9a3-9186-4abd-952f-e98b32e5c3ed None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.659495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e713be-aba5-48c2-aa52-1e0d2972c86a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.659765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e713be-aba5-48c2-aa52-1e0d2972c86a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.660054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e713be-aba5-48c2-aa52-1e0d2972c86a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.665712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 40/75] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:36.665712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e713be-aba5-48c2-aa52-1e0d2972c86a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.699448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.700172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.700461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.700775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.766660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e713be-aba5-48c2-aa52-1e0d2972c86a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.767874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:36.769456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:36.784227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.801136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.801999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.802324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.802657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.812866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:36.820859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:36.821716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:36.822481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 41/76] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:36.823115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.872891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:36.873637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 36/77] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:36.874366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:36.923775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4b71-4d50-4594-b48a-56d6eb40b5e5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.956948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:36.957743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.958029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.958304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.969128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:36.973945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be42b-216b-49de-83ee-422370d10126 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c5f18ddc-6635-4a02-9c5c-668e2c34cb42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:36.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:36.978081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:36.978918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 42/78] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:36.984839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:36.985142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:36.985436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:36.987930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.002058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:37.003276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:37.008873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.009749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.010034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.010315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.011626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.013128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.015316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 37/79] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:36 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.015973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.075223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 43/80] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:37.075988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.113587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6cac-90eb-409c-8347-6a3549eff283 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.128661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.148011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.148721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.149012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.149289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.150035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:37.150346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.151945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.160278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 38/81] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.160278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.191883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289017-2861-4556-8171-12d1a8c7fdf8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.203653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.225739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.226604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.226889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.227164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.238656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.238656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.238656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 44/82] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.238656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.260426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24c25-a809-4684-9263-fd8c24e8d038 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.295379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.296044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.296335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.296643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.297389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:37.297705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.299080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.306877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 39/83] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.309518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.332951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489460e-f336-4b15-ba4d-d2bf3ce007b1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.340811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.367446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.368155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.368441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.368768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.408904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2e03-5350-444c-a2d6-5c130583da5c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.411497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.436832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.438299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.443342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.444144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.444433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.444742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.445923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.447350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.453428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 40/84] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.453428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.540410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 45/85] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:37.541299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.547237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780bdfe-1cee-4e7f-8c3c-3274daee26c6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.550166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.582383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.583610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.583852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.584142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.585362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.586812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.588408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 41/86] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.589746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.632335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.639517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ea4d-0bdc-434c-88c8-b5286c3746c5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.672774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.673486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.673779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.674057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.674895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:37.675209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.676664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.681990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 46/87] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.682746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.691149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965e53f-5e65-474a-8af5-50816bd76ee4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.729123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.730639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.730992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.731352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.732723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.734203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.736077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 42/88] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.736877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.767686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.803147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd501-9fd6-4979-b380-52c91f1ea1d3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.839306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.839957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.840246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.840526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.841293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.842766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.857513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5a48-b8a7-4658-9013-b205c85cfac0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:37.867178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:37.892946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:37.893814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:37.894098 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:37.894371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:37.895559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:37.897036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:37.898720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 43/89] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:37.900412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:37.936003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 47/90] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:37 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:37.936966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.045990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32acc1-2734-4677-aa8c-399dee0c7dfe None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.094116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.095366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.095664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.095946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.097436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d18b9-d8f4-429a-9629-28c537ab0291 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.136378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:38.148104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.148802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.152912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.152912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.155312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:38.187965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.189482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.247757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.250271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.335699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:38.336502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.392005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:38.393059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.431602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:38.440889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:38.483648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c9f38-25c0-4917-88f2-595390ff92cf None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.553517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df87f-c5eb-4cf8-a9b5-b7d137efb706 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.563652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.564334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.564651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.564923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.565765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=1f293424a3574c11b9a214ef1e03ad05) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:38.566086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.567547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.587833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 45/93] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:38 2022] GET /identity/v3/role_assignments?user.id=1f293424a3574c11b9a214ef1e03ad05&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:38.588458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.629840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.630999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.631285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.631571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.637628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.639471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.642901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 49/94] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:38 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:38.648827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.795940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370c1f-d3a6-46aa-bc9e-6dd7307f97a4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.824417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:38.836814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258ade-1de7-4a71-a16c-aa2f23d02e5c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:38.858640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.859588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.859884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.860169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] PATH_INFO: `/v3/projects/d09e5008e49a4a19836152f2b76d1a2f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.862439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] RBAC: Authorizing `identity:get_project(project_id=d09e5008e49a4a19836152f2b76d1a2f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.865020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.869498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 46/95] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:38 2022] GET /identity/v3/projects/d09e5008e49a4a19836152f2b76d1a2f => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:38.873995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:38.898849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:38.899455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:38.899745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:38.900026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:38.900961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:38.901283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:38.910225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b147f8-b695-4739-b70f-16cc486c908a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:38.917965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 50/96] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:38 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=7513e8315142426297257e9970c65752 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:38.938178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:39.069855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e34c8-4647-4d41-b5a4-1f3f6169e210 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:39.116089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:39.116803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:39.117248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:39.117546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:39.118407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=d09e5008e49a4a19836152f2b76d1a2f, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:39.118732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:39.120238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31661714-cd6e-481e-812d-0bfc9941d2d1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:39.127834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 47/97] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:38 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=d09e5008e49a4a19836152f2b76d1a2f&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:40.889834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4605-c747-4691-9c25-98e5aadaebb1 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.890907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4605-c747-4691-9c25-98e5aadaebb1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.891400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4605-c747-4691-9c25-98e5aadaebb1 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.893144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 51/98] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:40.898798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3385-4519-4328-aed7-def2ea4ff988 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.899645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3385-4519-4328-aed7-def2ea4ff988 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.900323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3385-4519-4328-aed7-def2ea4ff988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.929634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b2bb3385-4519-4328-aed7-def2ea4ff988 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:40.931188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b2bb3385-4519-4328-aed7-def2ea4ff988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.015207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 48/99] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:41.047710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4605-c747-4691-9c25-98e5aadaebb1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.150538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a694b-c561-4f3a-8289-1625621f5ece None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.151152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a694b-c561-4f3a-8289-1625621f5ece None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.152204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a694b-c561-4f3a-8289-1625621f5ece None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.153832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 49/100] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:41.160671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.161231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.161715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.178360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:41.186219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4605-c747-4691-9c25-98e5aadaebb1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.193989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:41.195431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.277894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.278731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.279020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.279300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.280581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.282073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.283698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 52/101] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:41.305460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.319113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 50/102] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:41.357815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.359763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:41.502866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd06c-c1d9-4fa5-b8fd-c6737dcf1e31 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.508029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabb833-8e28-45ed-b75e-79a48eb7dc1f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.540889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:41.554814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.555116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.555798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.556084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.556366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.556788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.557118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.557499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.558714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.559139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c883e09-5d31-4176-99ac-aabf7b7e81b6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.578325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:41.595111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:41.596025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:41.596803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:41.599193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 51/103] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:41.605492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.686315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 53/104] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:38:41 2022] POST /identity/v3/projects => generated 302 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:41.688469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be68-a686-4341-a99b-382e028900c3 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.688861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be68-a686-4341-a99b-382e028900c3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.689153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be68-a686-4341-a99b-382e028900c3 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.690462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 54/105] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:41.697087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.697386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.697676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.734841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:41.737929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.791936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f16c7-63c3-46c3-8239-d898652f41ed None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.854146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 55/106] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:41.866010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.866715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.867011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.867297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.868066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:41.868382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.869844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.884915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 52/107] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:41.890500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.906185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.016586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.146083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.183379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75606a-2b3a-4254-972e-a8eb9acd9afa None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.228292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468953d-5d17-40b1-9099-d29caba5af67 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.238104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.239015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.239301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.239580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.244107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:42.245916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6121-075d-4434-8413-c3983e339b94 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:42.247690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 56/108] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:42.248882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1134-5c7d-4e52-8701-2d8da8d92878 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.249368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1134-5c7d-4e52-8701-2d8da8d92878 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.249482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca1134-5c7d-4e52-8701-2d8da8d92878 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.250742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 57/109] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:42.251807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a061d-0934-4a75-bcc9-c8e713787084 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.252096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a061d-0934-4a75-bcc9-c8e713787084 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.252376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a061d-0934-4a75-bcc9-c8e713787084 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.253629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 58/110] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:42.258833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a061d-0934-4a75-bcc9-c8e713787084 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.288063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.289028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.289576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.289868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.302151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a8c2f071-e8bc-4f5f-8e4a-ee9699cdc4fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:42.310551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:42.311533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:42.312312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 53/111] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:42.313840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f922-a7c1-4832-bf72-ec574d8afcd5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.313840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f922-a7c1-4832-bf72-ec574d8afcd5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.313840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f922-a7c1-4832-bf72-ec574d8afcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.331535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-5a48f922-a7c1-4832-bf72-ec574d8afcd5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:42.332755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5a48f922-a7c1-4832-bf72-ec574d8afcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:42.357754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.385219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a061d-0934-4a75-bcc9-c8e713787084 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.406751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 54/112] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:42.407875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.408177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.408478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.428558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:42.430104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:42.437713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.438492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.438783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.439088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.440262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:42.442240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7ea73-e0b4-4d0a-994b-93f5937069e4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:42.445542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 59/113] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:42.447852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b88c9-dc89-4f38-b3af-73556623a37b None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.447852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b88c9-dc89-4f38-b3af-73556623a37b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.447852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b88c9-dc89-4f38-b3af-73556623a37b None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.448360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 60/114] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:42.449284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b88c9-dc89-4f38-b3af-73556623a37b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.490575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.522426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 55/115] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:42.523278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.581119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b88c9-dc89-4f38-b3af-73556623a37b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.616360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.617139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.617337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.617615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.618366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:42.618670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:42.620054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:42.628959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 61/116] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:42.629737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.638957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.641794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04a1f-6887-41f9-973c-765d917b009c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.686297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.687291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.687587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.687874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.700594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-79d1477a-77bb-4dde-811f-240f95b6c952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:42.708346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:42.709254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:42.710014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 56/117] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:42.711153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.711153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.711314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.728383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:42.729683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:42.745549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89861c1-d6bf-4d40-afd3-de89ad7af5c3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.759836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.779275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.781718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.781718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.781718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/0d79746eda4c49dda869a0af4205213f/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.782863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, user_id=0d79746eda4c49dda869a0af4205213f, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:42.784316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:42.803300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 57/118] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:42.803969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.854609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 62/119] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:42 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/0d79746eda4c49dda869a0af4205213f/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:42.854609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:42.920115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78661342-0b4d-4d43-adb1-88ccef3797cc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:42.959957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:42.960170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:42.961230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:42.961584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:42.961873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:42.974272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:42.983689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:42.984598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:42.985397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 58/120] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:42.990119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.003354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ccb1-e55c-4cc8-a558-ccd25cbc0aa1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.027113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.046562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.047494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.047832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.048549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] PATH_INFO: `/v3/users/d8625287bdb04303a96e7542252330a8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.065938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] RBAC: Authorizing `identity:get_user(user_id=d8625287bdb04303a96e7542252330a8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.067399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.069315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 63/121] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/users/d8625287bdb04303a96e7542252330a8 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.074007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.115422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700e7f1-3cc1-4360-bb1b-37166eb5e192 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.154607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.155645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.156149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.156438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.157241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:43.157557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.159085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.170474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 59/122] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.174301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.194083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481a44c-993a-4b10-98fd-533c2346258e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.226603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.240685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.241868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.242165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.242450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.256804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:43.267396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:43.268307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:43.269117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 64/123] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:43.269762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.286512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.303130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ba88-51fe-4965-b125-38cb1b6a1542 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.342855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.344016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.344502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.345056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.346042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:43.346713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.348365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.358131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 60/124] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.359287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.406956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4d2ff-6428-4c03-a2ad-f4342aeadf31 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.450228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.450894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.451187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.451470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.475526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafacf-dfd8-4fb2-90dc-90f5edb53dfc None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.519433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.520135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.520241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.520516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.520826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.522503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.524226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.531949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 61/125] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.531949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.541536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.543853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.552982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.648498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24fd3-a990-4cec-905f-808a6fb69209 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.666907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:43.669121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.698119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.699473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.699763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.700044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.701019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:43.701333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.703416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.716699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 62/127] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.717873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.770288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.787231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd1387-bb59-45a6-868f-78696971e049 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.825709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:43.829310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.830476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.830995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.831468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.832912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.834680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.836711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 66/128] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.837728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.853652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43354f9-77bc-476b-b953-6de8696a4719 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.897622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.898493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.898783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.899066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] PATH_INFO: `/v3/projects/d09e5008e49a4a19836152f2b76d1a2f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.900253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] RBAC: Authorizing `identity:get_project(project_id=d09e5008e49a4a19836152f2b76d1a2f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:43.902502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:43.904365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 63/129] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/projects/d09e5008e49a4a19836152f2b76d1a2f => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:43.905948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:43.952423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff1a7-b8c6-4b1f-a891-69bb4848466a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:43.996767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:43.997632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:43.997916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:43.998192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:43.999393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.001321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.003380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 67/130] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:44.005355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.032076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8aa7f-f0df-4748-891d-8fd99331a80d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.034862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:44.076438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.077871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.078367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.078859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.080586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.082542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.084897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 64/131] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:43 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:44.085965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.107551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:44.154871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb507ac-8b3b-40e7-a5a1-cdfafd13b51b None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.194787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ab172-4e15-4622-b6bd-3fa3e597cfc6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.202185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.203574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.203880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.204162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.205822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.207692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.216693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 68/132] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:44 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:44.217679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.247361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.248959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.249261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.249803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] PATH_INFO: `/v3/projects/d09e5008e49a4a19836152f2b76d1a2f/users/0d79746eda4c49dda869a0af4205213f/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.252478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d09e5008e49a4a19836152f2b76d1a2f, user_id=0d79746eda4c49dda869a0af4205213f, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.254403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.309637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:44.321489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfc636-4a17-4ccf-afbb-935e974f3b34 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.354361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.355227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.355562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.355843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.356706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=d8625287bdb04303a96e7542252330a8) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:44.357020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.358510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.368956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 65/133] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:44 2022] PUT /identity/v3/projects/d09e5008e49a4a19836152f2b76d1a2f/users/0d79746eda4c49dda869a0af4205213f/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:44.368956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.383530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 69/134] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:44 2022] GET /identity/v3/role_assignments?user.id=d8625287bdb04303a96e7542252330a8&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:44.384737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.529331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:44.593510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234474-2c08-4afd-ab2e-59f91b8f98c3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.623819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693523-6ed8-451f-a73b-3e1f8106c299 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.650816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.652350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.652902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.653838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.657526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.659304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819d51-5589-4f49-9595-f4162854ca06 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.662128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 66/135] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:44 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:44.669385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15886-769f-4315-a57d-0818f7c18a45 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.669686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15886-769f-4315-a57d-0818f7c18a45 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.670164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15886-769f-4315-a57d-0818f7c18a45 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.671822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 67/136] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:44.673360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15886-769f-4315-a57d-0818f7c18a45 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:44.685822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.686749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.687038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.687308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/0d79746eda4c49dda869a0af4205213f/roles/7513e8315142426297257e9970c65752` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.689724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, user_id=0d79746eda4c49dda869a0af4205213f, role_id=7513e8315142426297257e9970c65752)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.691348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b2e7-7424-40ac-8b1e-f6674c2f7e4d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.790555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 70/137] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:44 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/0d79746eda4c49dda869a0af4205213f/roles/7513e8315142426297257e9970c65752 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:44.791867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.792220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.794015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.826238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15886-769f-4315-a57d-0818f7c18a45 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:44.841101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:44.842472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:44.861786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:44.904313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:44.905270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:44.905564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:44.905854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/1f293424a3574c11b9a214ef1e03ad05/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:44.909636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, user_id=1f293424a3574c11b9a214ef1e03ad05, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:44.911170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7e86-9bc4-4842-a329-3989a37d7be9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:44.997993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 71/138] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:45.009870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:44 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/1f293424a3574c11b9a214ef1e03ad05/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:45.043572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:45.191547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b57c57-c64f-4cdf-b695-173fa1a6072e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:45.241568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8de8-2031-4bb9-bf2d-5a3afb9cf764 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.242825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8de8-2031-4bb9-bf2d-5a3afb9cf764 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.243600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8de8-2031-4bb9-bf2d-5a3afb9cf764 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.245982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 69/140] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:45.253430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:45.254256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.254548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.254836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.255221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.255702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.256142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:45.256532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.257838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:45.259795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 72/141] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:45.266608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:45.270060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:45.285960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:45.287558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:45.287781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:45.406618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bea31-250b-43dd-b4ee-cc3d3aed2da6 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:45.439543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 70/142] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:45.446107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:45.446824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.447143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.447539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.448979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:45.450538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:45.491937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:45.578744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 73/143] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:45 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:45.645817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb4cf6-b3e0-4c93-bda7-1ca0a67e26ca None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:45.697259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:45.703842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:45.704906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.705202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.711006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.722550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:45.733529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:45.734693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:45.735454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:45.736910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 71/144] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:45.741752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:45.829929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:45.869292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd6dd-94cf-4b58-955d-37e71ee4a285 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:45.912184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:45.913149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:45.913607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:45.914030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:45.914930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:45.915395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:45.917794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:45.928694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:45.936004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:46.124376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b66fd-126e-4323-a921-8db6f6afe940 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:46.170282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:46.171443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:46.171443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:46.171813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:46.172999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:46.174490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:46.176180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:45 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:46.182033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:46.296501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f2648-2455-4765-bb55-0a114911b203 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:46.329063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:46.331817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:46.332480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:46.332809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:46.333169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:46.404969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:46.406369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:46.510582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:46.516897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:46.581813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:46.627856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95caf0-2b1d-4bb0-b5f1-2c2eed648614 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:46.666713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:46.668298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:46.668590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:46.668910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:46.670128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:46.671586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe7c7-0a7f-48d9-964a-88f55dd07752 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:46.673607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 73/148] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:46 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:46.679415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:46.710315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:46.786978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a321-cc78-40df-948f-851790a687e0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:46.824306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:46.825061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:46.825355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:46.825681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:46.826538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:46.827014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:46.828588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaeb25-5ca7-4905-954a-e58b3a612f0d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:46.835379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 76/149] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:46 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:47.716388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f627d-5b9c-407a-9775-10f20dde5d52 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:47.717115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f627d-5b9c-407a-9775-10f20dde5d52 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:47.717115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f627d-5b9c-407a-9775-10f20dde5d52 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:47.718584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 74/150] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:47.724437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:47.725027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:47.726932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:47.757652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:47.758859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:47.835182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 77/151] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:47.860030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f627d-5b9c-407a-9775-10f20dde5d52 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:47.973981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f627d-5b9c-407a-9775-10f20dde5d52 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.002376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.010197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.011175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.011554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.011844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.023344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3e6f155f-1148-4bbf-b9f1-9a4a3a67a4d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:48.032030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:48.032936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:48.034125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 75/152] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:48.039417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.057757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c3c4-e2a7-4f18-9c2e-b7dc61197475 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.058139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c3c4-e2a7-4f18-9c2e-b7dc61197475 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.058383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c3c4-e2a7-4f18-9c2e-b7dc61197475 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.059870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 76/153] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:48.065148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.065436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.065716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.081700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.097629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:48.099464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:48.194231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 77/154] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:48.221501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.228135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55658b-252e-4853-a6cf-9fc411352a22 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.329911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.330617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.330907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.331191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.331959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:48.332273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.333730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.341110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277eac-9be1-45ba-a25f-1955b84b03d9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.357051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 78/155] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:48.365299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.366079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.384659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.391685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.391685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.391685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.399858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:48.409681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:48.410636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:48.411817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 78/156] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:48.417900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.508722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.526075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105e56-4a73-4edb-8a4b-64e39959dc51 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.539824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ee4b-d00d-4c2d-8ede-8ead66f66d6c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.563302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.564090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.564386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.564786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.565568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:48.565887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.567414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.577651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 79/157] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:48.583500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.587131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.588038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.588328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.588633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.590747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.592262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.593999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 79/158] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:48.599956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.645645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.705594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45046a-e50f-4fc6-9c90-cf86f52cc133 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.709307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e28e-e034-45c7-8dcf-49815d6bbba9 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.748342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.749457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.749754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.750036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] PATH_INFO: `/v3/users/d8625287bdb04303a96e7542252330a8` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.751296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] RBAC: Authorizing `identity:get_user(user_id=d8625287bdb04303a96e7542252330a8)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.752795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d668f-3ae7-4803-857c-93ae6a2f464f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.753944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.754707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.754954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 80/159] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/users/d8625287bdb04303a96e7542252330a8 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:48.755063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.755265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.756192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb290-496e-4fdb-a003-966d6bf5d2bc None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.756480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb290-496e-4fdb-a003-966d6bf5d2bc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.761041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb290-496e-4fdb-a003-966d6bf5d2bc None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.762616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 81/160] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:48.770700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bb290-496e-4fdb-a003-966d6bf5d2bc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:48.797164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.874781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.876267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.888451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bb290-496e-4fdb-a003-966d6bf5d2bc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:48.898561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:48.926786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:48.927704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.928005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.928334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.929623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:48.931214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd51ac4-3972-41cb-a2c5-9a8844d99437 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:48.934576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 82/161] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:48.935754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:48.936054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:48.936340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:48.961593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:48.962864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:49.040640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 83/162] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:49.041328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.077823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 80/163] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:49.083350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.175116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:49.188951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53cd89-50f5-4465-832f-c97a311eb73a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:49.196945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:49.228242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:49.236130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.236130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.236130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/d8625287bdb04303a96e7542252330a8/roles/635966e6bee54755a655e89fdd4d1c24` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.237031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, user_id=d8625287bdb04303a96e7542252330a8, role_id=635966e6bee54755a655e89fdd4d1c24)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:49.238031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415114ad-7ffd-4c1a-88c1-d89bfaa06586 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:49.263137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1c54-9258-4337-9645-8f966e5877dc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:49.301420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:49.302264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.302557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.302842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] PATH_INFO: `/v3/projects/d09e5008e49a4a19836152f2b76d1a2f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.304115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] RBAC: Authorizing `identity:get_project(project_id=d09e5008e49a4a19836152f2b76d1a2f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:49.305849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:49.308679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 81/164] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/projects/d09e5008e49a4a19836152f2b76d1a2f => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:49.309474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.339574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 84/165] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:49 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/users/d8625287bdb04303a96e7542252330a8/roles/635966e6bee54755a655e89fdd4d1c24 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:49.340949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ff65-60ac-4692-a987-702f053b6e32 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.341240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ff65-60ac-4692-a987-702f053b6e32 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.341518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ff65-60ac-4692-a987-702f053b6e32 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.342803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 85/166] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:49.343522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ff65-60ac-4692-a987-702f053b6e32 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.524196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fd34-4f2a-4ae6-a968-8a95f1ef2059 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:49.531160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ff65-60ac-4692-a987-702f053b6e32 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:49.566978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:49.594973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:49.595789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.596078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.596359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.613756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:49.614191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:49.614964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.615250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.615521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.617530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=d09e5008e49a4a19836152f2b76d1a2f, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:49.617530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:49.618628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-20837222-2317-40a0-83da-8921f478dfb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:49.623186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:49.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:49.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 82/167] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:49.630912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.630912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.630912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.636915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 86/168] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=d09e5008e49a4a19836152f2b76d1a2f&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:49.636915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.657211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:49.658487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:49.689020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:49.817320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 83/169] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:49.837529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac084d8-386b-4233-b916-c3116ffd425e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:49.863780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:49.924413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:49.925140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:49.925427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:49.925699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:49.926471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:49.926781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:49.928210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:49.950764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 87/170] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:49.957022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.086595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.099309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7a78-3d5b-42a8-b66f-a16bcd2819da None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.130875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00653-28fb-4ed3-add5-a918c929b783 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.146236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.147942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.148377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.148826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] PATH_INFO: `/v3/users/1f293424a3574c11b9a214ef1e03ad05` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.152015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.153805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] RBAC: Authorizing `identity:get_user(user_id=1f293424a3574c11b9a214ef1e03ad05)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:50.155452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:50.157528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 88/171] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/users/1f293424a3574c11b9a214ef1e03ad05 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:50.163385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.218714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.219782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.220248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.220695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.253981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-0898cde8-29a2-4ae0-b6e7-08f158fe1774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:50.263285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:50.264365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:50.269329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:50.270231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 84/172] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:50.271323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fada-f0ac-428e-95d6-248eb0c909a8 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.271613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fada-f0ac-428e-95d6-248eb0c909a8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.271892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fada-f0ac-428e-95d6-248eb0c909a8 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.273204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 85/173] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:50.281494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320fada-f0ac-428e-95d6-248eb0c909a8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.281639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981d35-e0d9-4439-9171-4d903130d91b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.318324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.318988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.319274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.319546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.350373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.394681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:50.396481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682a02-8b55-497b-a8aa-e024d456c6ae None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:50.505621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 89/174] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:50.507223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.507727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.508144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.526808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:50.528263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:50.540468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320fada-f0ac-428e-95d6-248eb0c909a8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.591698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.612738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 90/175] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:50.612738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.613008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.613008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.613008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.613008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.613327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:50.613327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:50.613327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:50.627698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 86/176] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:50.632800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.677659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.727753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a623-9ac0-4e65-aa4b-f6ef26ac0b9b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.802024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.803257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.804415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.805385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.808671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7786-fdbb-463a-b77f-fc455d9c0385 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:50.809512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:50.811128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:50.814319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 91/177] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:50.815495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.867306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:50.868829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:50.869260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:50.871149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] PATH_INFO: `/v3/users/0d79746eda4c49dda869a0af4205213f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:50.873244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] RBAC: Authorizing `identity:get_user(user_id=0d79746eda4c49dda869a0af4205213f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:50.878487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:50.880723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 87/178] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/users/0d79746eda4c49dda869a0af4205213f => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:50.886313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:50.928116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:50.975107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212f71-8b9f-4ee8-b1ee-d0e99f4654a4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.014809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.015923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.016550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.016984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.038348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:51.047372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:51.048424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:51.049348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:51.051267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 92/179] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:51.052227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.131659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.134717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ec0e-598e-4645-b583-2da6d7bdf223 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.161978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4256-ee1a-400f-ac47-68a4de2cfc10 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.175521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.176362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.177045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.177339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.178474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=1f293424a3574c11b9a214ef1e03ad05) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:51.178797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.179956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.180808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.196644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 88/180] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:50 2022] GET /identity/v3/role_assignments?user.id=1f293424a3574c11b9a214ef1e03ad05&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:51.196644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.201178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.202008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.202368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.202642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.286450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.288336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e88b7-bf1e-4665-acc1-b02956721fcf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.339397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b11eb-f1a1-44bb-8156-42776b2dcc7e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.377190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.378196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.378647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.379111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.380008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:51.380456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.382088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67534ab3-7017-4623-94ba-6a0916485e6d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.392006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 89/181] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:51.394554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefefe4-b3b5-4da3-91f5-e8da0a217807 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.394996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefefe4-b3b5-4da3-91f5-e8da0a217807 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.395414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefefe4-b3b5-4da3-91f5-e8da0a217807 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.397007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 90/182] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:51.398398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f057-e031-4e22-9d5a-2bfca13b5928 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.398875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f057-e031-4e22-9d5a-2bfca13b5928 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.399328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f057-e031-4e22-9d5a-2bfca13b5928 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.400814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 91/183] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:51.402396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f057-e031-4e22-9d5a-2bfca13b5928 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.411426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 93/184] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:51.417660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec3b7-d632-4754-8332-13d0c4da886c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.417969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec3b7-d632-4754-8332-13d0c4da886c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.418257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec3b7-d632-4754-8332-13d0c4da886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.434937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-00eec3b7-d632-4754-8332-13d0c4da886c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:51.436138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-00eec3b7-d632-4754-8332-13d0c4da886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:51.436692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.452291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.519913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 94/185] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:51.521876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.522608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.523293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.525901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f057-e031-4e22-9d5a-2bfca13b5928 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.543939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:51.545457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:51.561923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.563146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.563547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.563827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.578468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.579920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.581932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 92/186] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:51.582746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.614427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 95/187] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:51.615100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.678150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.693960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c514b-7327-4e83-b9a0-b161856580ea None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.708573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.731203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465dfbc-a2c4-4661-a895-bc46e5b03fd3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.733473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.734428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.734864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.735142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.736336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.737844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.739563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 93/188] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:51.740304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.773147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.774201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.774487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.774788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.786109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:51.794658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:51.795632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:51.796445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 96/189] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:51.797164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.849233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c430b-4a0a-424e-9eb9-166894e714ef None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.889547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.890622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.892816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.896010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.902960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dd57-21c1-4803-9377-ec82be590bff None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:51.929382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.939488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:51.940309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:51.940564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:51.944466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:51.944466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.944466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:51.945440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 97/190] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:51.946115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:51.955706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.990280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:51.992301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.048400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dab10-27c5-4a94-a392-486b3e139f24 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.082831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.083760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.084263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.084539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.085402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=0d79746eda4c49dda869a0af4205213f) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:52.085715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.087150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.093339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 98/191] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/role_assignments?user.id=0d79746eda4c49dda869a0af4205213f&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=7513e8315142426297257e9970c65752 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:52.100883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.110275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 94/192] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:52.111332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.190012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:52.192499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:52.225523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ecd2-51c6-44e1-9904-991e829c2486 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.266648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00590-da9d-4239-98e3-c7a09feb3450 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.275503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.277195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.277585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.278450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.278943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:52.279351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.281152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.290885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 99/193] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:52.292407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.315097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.315430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.315845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.315967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.317496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.318182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.404078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378ad0-d86b-4501-9bbe-c80c2ab72065 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.422024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 95/194] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:52 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:52.433765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.435121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:52.440753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.441709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.441995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.442268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.443583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.445139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953a10-403b-44b4-8616-ab5e9f8738ac None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.447172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 100/195] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:52.448552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e6a7-9217-4ec8-9e05-e61b9d36bf2d None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.448951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e6a7-9217-4ec8-9e05-e61b9d36bf2d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.449238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e6a7-9217-4ec8-9e05-e61b9d36bf2d None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.450793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 101/196] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:52.453892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e6a7-9217-4ec8-9e05-e61b9d36bf2d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.574798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875cdc3-7d3f-4287-861c-4833f40b9da1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.578870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e6a7-9217-4ec8-9e05-e61b9d36bf2d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.585429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:52.614483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.614752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.616170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.616170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.617921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.619246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58b198-4036-4a9d-885e-c0b8fc8543bc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.621754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 96/197] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:52.624652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.624652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.624652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.626622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.626622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.627822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.627822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.628013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=7fa8d9e83be44e48a5f13fbf321c3fef) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:52.628250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.629805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.637055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 102/198] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/role_assignments?user.id=7fa8d9e83be44e48a5f13fbf321c3fef&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:52.638446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.644113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:52.645364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:52.738864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:52.756758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 97/199] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:52.786116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:52.792572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57eb51-e587-4606-9617-9606474187e2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.837256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:52.837935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:52.838224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:52.838865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:52.944861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:52.946352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:52.951092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c50a1-33cb-4bf4-a10d-b796b7f8a05b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:52.964331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:53.011384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.012540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.013060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.013539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.033605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:53.043424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:53.044328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:53.045159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:53.047977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 98/200] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:38:53.054138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:53.069405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:53.146966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 103/201] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:53.156025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:53.233890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa842d-f599-4d2a-91b5-c0e906c85bf9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:53.272424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.273078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.273368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.273652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.274421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:53.274801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:53.280662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:53.286274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 99/202] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:53.289503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46fba7-c91c-4598-88db-158cba9c39f9 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:53.294944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:53.352976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:53.370805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.371875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.372162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.372444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.377391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:53.378834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:53.380910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 104/203] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:53 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:53.386789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:53.445852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:53.475387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83034-b693-4a21-9e43-15b16e1ca6c2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:53.545458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.546278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.546560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.546839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] PATH_INFO: `/v3/users/d8625287bdb04303a96e7542252330a8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.549350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] RBAC: Authorizing `identity:get_user(user_id=d8625287bdb04303a96e7542252330a8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:53.550815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:53.552793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 100/204] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:53 2022] GET /identity/v3/users/d8625287bdb04303a96e7542252330a8 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:53.559467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:53.574837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627bde-d3ef-4505-8c13-9b1664fe94ca None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:53.645480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.646526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.647017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.647494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.648557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=7fa8d9e83be44e48a5f13fbf321c3fef) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:53.649125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:53.650770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:53.665353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 105/205] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:53 2022] GET /identity/v3/role_assignments?user.id=7fa8d9e83be44e48a5f13fbf321c3fef&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=7513e8315142426297257e9970c65752 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:53.720979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:53.729011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa6e3-dc03-4356-b072-b079a2d2d64a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:53.785229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:53.786277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:53.786772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:53.787256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:53.866129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:53.867568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:54.060174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:54.066814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 101/206] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:38:54.072488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:54.184636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:54.190637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4775-708a-441e-954b-c3a7ae0d5957 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:54.242496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:54.243364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:54.243648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:54.243923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:54.249318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:54.250775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcfeb9-89df-4d13-9038-94c533143213 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:54.252808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 106/207] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:54 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:54.258458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:54.429696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0bf0c-2d73-4bfa-ab2a-8a7e3a1089ae None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:54.480493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:54.481168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:54.481456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:54.481737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:54.482583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, scope.project.id=fef5815a0fd04634bf2ef840a861e801, user.id=d8625287bdb04303a96e7542252330a8) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:54.482897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:54.484341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a1c8-9871-459a-83af-19d1ec28cbc7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:54.493127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 102/208] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:54 2022] GET /identity/v3/role_assignments?user.id=d8625287bdb04303a96e7542252330a8&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:55.308933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cecb-17a6-44e5-9512-184dc84c8133 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.309894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cecb-17a6-44e5-9512-184dc84c8133 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.310374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cecb-17a6-44e5-9512-184dc84c8133 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.311105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655877c4-24d1-4094-b5e0-75f2e9d06acc None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.311478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655877c4-24d1-4094-b5e0-75f2e9d06acc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.311675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655877c4-24d1-4094-b5e0-75f2e9d06acc None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.313070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 107/209] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:55.314284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 103/210] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:55.318442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.318735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.319244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.320048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32ad8-a558-40c1-bf2a-6c46fbcaddf8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.320412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32ad8-a558-40c1-bf2a-6c46fbcaddf8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.320778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32ad8-a558-40c1-bf2a-6c46fbcaddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.336732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:55.338208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:55.339498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-10e32ad8-a558-40c1-bf2a-6c46fbcaddf8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:55.340909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-10e32ad8-a558-40c1-bf2a-6c46fbcaddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:55.409333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 108/211] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:55.420941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:55.431206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 104/212] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:55.436717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.441956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7699-1454-43a4-a967-48d24ebd9aa7 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.442481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7699-1454-43a4-a967-48d24ebd9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.442929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7699-1454-43a4-a967-48d24ebd9aa7 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.444453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 105/213] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:38:55.451552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.451552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.451552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.468893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:55.470584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:55.538306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:55.543915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 106/214] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:38:55.546811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebdd03-a10e-44be-80c7-3011e473c7cc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:55.550342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.584228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:55.585072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.585365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.585649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.586848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:55.588313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:55.590901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 109/215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:55.590901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.673326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44fbb-88f8-4df0-be0b-5cfdb6c0e04d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:55.694628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:55.705347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a203-9197-48a0-a8e4-d00e89ed0df1 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:55.709242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:55.710044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.710333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.710607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.720943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:55.729808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:55.731068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:55.732056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 107/216] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:55.736791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.750838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:55.751916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.752213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.752684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.765490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:55.773277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:55.774167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:38:55.774942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:55.779587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 110/217] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:55.780568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.806939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:55.842166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad08fba-aee5-45af-8ee4-58d310dd583e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:55.878744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:55.879427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.879713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.879990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.881162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:55.882623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:55.894002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688b2c-62d0-4120-accb-32e2c49d5e5f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:55.929890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:55.930567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:55.930857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:55.931139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:55.931901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:55.932878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:55.934262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:55.942420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 111/218] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:55.943223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:55.986915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 108/219] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:55 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:38:55.988693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.037264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.052972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.061153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d43-4e0b-4882-b598-9d541b700d9b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.112158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.113792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.114285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.114762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.116110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:56.117016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.119010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.130742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 112/220] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:56.136441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.149402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3c4c-206d-436d-b8ff-5345d673b004 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.199040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.200442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.201000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.201479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.203883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.205638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.207492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 109/221] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:55 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:56.216705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.262919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c8e56-e998-4555-9a0f-d5ffb3e00bd7 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.303936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.304883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.305177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.305488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] PATH_INFO: `/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.321951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] RBAC: Authorizing `identity:get_user(user_id=c6d8115e4f6d487eb08f9ec390dcaf15)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.323643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df8e4-6807-4fce-bbf4-359457ed255d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.325612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 113/222] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:56 2022] GET /identity/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:56.326737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966b9f-0622-48c1-8e85-0366b7a205c3 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.327023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966b9f-0622-48c1-8e85-0366b7a205c3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.327359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966b9f-0622-48c1-8e85-0366b7a205c3 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.332932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 114/223] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:56.333499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966b9f-0622-48c1-8e85-0366b7a205c3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.338097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.356905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67db460-35d9-476e-a47c-ef8f8a323b21 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.360347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.399829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.400892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.401252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.401610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.403213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.404699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb25a00-b0bf-48f8-8b12-0e26f9e29abc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.406462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 110/224] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:56 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:56.407630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.407926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.408210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.429312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:56.430510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:56.468368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966b9f-0622-48c1-8e85-0366b7a205c3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.514434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 111/225] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:56.515572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.521524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.522219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.522512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.522796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.613075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.614478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.618107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.646116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983334-69ee-467d-ac6f-fd82670c6526 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.648423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:56.694565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:56.696154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:56.696878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:56.697311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/users/7fa8d9e83be44e48a5f13fbf321c3fef/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:56.700247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, user_id=7fa8d9e83be44e48a5f13fbf321c3fef, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:56.702632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:56.743406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 115/226] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:56.743406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.781382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 112/227] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:56 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/users/7fa8d9e83be44e48a5f13fbf321c3fef/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:56.782633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:56.953896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe06bd-1a44-4046-a488-7944cae21b5e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:56.971537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:57.012189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4197713-f979-4673-848c-1317627c0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.013306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4197713-f979-4673-848c-1317627c0334 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.013599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4197713-f979-4673-848c-1317627c0334 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.014325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4197713-f979-4673-848c-1317627c0334 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.029864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e940-5250-4bb0-96fa-bcf9f20f39da None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.030823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4197713-f979-4673-848c-1317627c0334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-f4197713-f979-4673-848c-1317627c0334 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:57.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:57.043801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:38:57.044582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:38:57.045701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 116/228] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:57.052285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4197713-f979-4673-848c-1317627c0334 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:57.078319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28671500-a189-45ca-982b-d02237bf85de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.079253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671500-a189-45ca-982b-d02237bf85de None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.079544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671500-a189-45ca-982b-d02237bf85de None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.079827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671500-a189-45ca-982b-d02237bf85de None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.081994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28671500-a189-45ca-982b-d02237bf85de None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.084133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28671500-a189-45ca-982b-d02237bf85de None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.087217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 113/229] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:56 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:57.093259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28671500-a189-45ca-982b-d02237bf85de None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:57.130806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:57.192146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4197713-f979-4673-848c-1317627c0334 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.212342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28671500-a189-45ca-982b-d02237bf85de None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.246007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.247999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.249327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.250020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.252291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:57.252821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.255612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.278746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 117/230] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:57.281839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:57.292899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.293835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.294310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.294779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.295801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=c6d8115e4f6d487eb08f9ec390dcaf15) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:57.296294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.298633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.304867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 114/231] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:57 2022] GET /identity/v3/role_assignments?user.id=c6d8115e4f6d487eb08f9ec390dcaf15&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:57.331646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:57.416946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f87fa-0177-42ba-aedf-d576c7b142eb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.456282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.457491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.457991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.458450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.459841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.461517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.463551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 118/232] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:57 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:57.469268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:57.601269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:57.611372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bd29-34bc-4de1-9c3c-4d63460d11f5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.659316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.660478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.661001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.661461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.662844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.664464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8aeb-8402-4e20-b014-03b3038a6e25 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.666951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 115/233] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:57 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:57.674883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:57.777669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:57.785173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d477-bafe-4603-aaf3-fec04df03832 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:57.835097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:57.836005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:57.836381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:57.836689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/users/7fa8d9e83be44e48a5f13fbf321c3fef/roles/7513e8315142426297257e9970c65752` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:57.842467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, user_id=7fa8d9e83be44e48a5f13fbf321c3fef, role_id=7513e8315142426297257e9970c65752)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:57.843939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e774ef-7169-44d5-b9a3-a639f9de4195 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:57.975508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 119/234] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:38:57 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/users/7fa8d9e83be44e48a5f13fbf321c3fef/roles/7513e8315142426297257e9970c65752 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:58.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f016f8-b357-4a2b-a81a-c1dc7ddb5f50 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:58.549268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f016f8-b357-4a2b-a81a-c1dc7ddb5f50 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:58.549785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f016f8-b357-4a2b-a81a-c1dc7ddb5f50 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:58.551387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 116/235] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:58.562070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:58.562958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:58.563445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:58.580797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:58.582269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:58.656829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 120/236] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:58.688440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f016f8-b357-4a2b-a81a-c1dc7ddb5f50 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:58.836995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f016f8-b357-4a2b-a81a-c1dc7ddb5f50 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:58.879889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:58.881064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:58.881679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:58.882157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:58.897750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:38:58.907130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:38:58.908011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:38:58.908834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:38:58.911250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 117/237] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:38:58.918226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.016200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:59.034308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401178-60b1-4c1d-b974-ed7182a50ac1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.074987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.076033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.076552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.077131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.078091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:59.078603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.081066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8e48-e615-4a9f-9954-0efdc5561cb3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.091744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 121/238] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:38:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:59.096818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.110356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4192-f8c6-4668-bde9-6722f23cac6e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.113578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4192-f8c6-4668-bde9-6722f23cac6e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.114114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4192-f8c6-4668-bde9-6722f23cac6e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.115730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 122/239] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:59.122753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.123528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.124750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.149287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:59.158183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:59.161588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:59.278716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01106fa4-ecbb-4dfc-bbac-4de1215fbcf9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.305706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 123/240] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:38:59.331311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.345438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.346273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.346565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.346847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] PATH_INFO: `/v3/users/0120e486c52e4ad1aecd80218b7b0b8b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.370875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] RBAC: Authorizing `identity:get_user(user_id=0120e486c52e4ad1aecd80218b7b0b8b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.372348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.374646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 118/241] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:38:59 2022] GET /identity/v3/users/0120e486c52e4ad1aecd80218b7b0b8b => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:59.380192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.466736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:59.474084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:59.496180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188b1b-2b37-41d6-af26-1945bd70c230 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.526957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6dd92-18da-4562-9e00-d642efef1f80 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.535353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.536016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.536304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.536585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.624102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.625626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.629497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.630306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.630646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.630932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.633635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.635642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.641768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 124/242] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:59.663668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.773339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:59.794173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 119/243] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:38:59.799598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.841134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716f27-4c2c-4a00-9bc2-d3cb721ff018 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.883475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.884572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.885758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.886493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.887411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.889232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217c5da-651b-4f0a-81e2-3aaab24ac573 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.911152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151801d-4c18-47f4-8c86-e5f90bc0f4cc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:59.944583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:59.945464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.945753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.946035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.947208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:59.949249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456324d-b4f6-4fc7-8d33-7b6c9c985ad8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:59.950934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 120/244] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:38:59 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:38:59.952204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bf40-96df-4eae-8656-bf0e84087091 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.952495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bf40-96df-4eae-8656-bf0e84087091 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.952866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bf40-96df-4eae-8656-bf0e84087091 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.954251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 121/245] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:59.955244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9e33-a877-4019-991c-9cc39c3b5598 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:59.956643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9e33-a877-4019-991c-9cc39c3b5598 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:59.956643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9e33-a877-4019-991c-9cc39c3b5598 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:59.957086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 122/246] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:38:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:59.957801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae9e33-a877-4019-991c-9cc39c3b5598 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:59.999692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.005162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 125/247] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:38:59 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:00.006280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c3f5-c17e-4621-8460-02c9effc8695 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.006658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c3f5-c17e-4621-8460-02c9effc8695 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.007175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c3f5-c17e-4621-8460-02c9effc8695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.015091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.027069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b796c3f5-c17e-4621-8460-02c9effc8695 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:00.028593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b796c3f5-c17e-4621-8460-02c9effc8695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:00.092196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae9e33-a877-4019-991c-9cc39c3b5598 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.136032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.137138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 126/248] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:00.137507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.138042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.138573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.138695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.138932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.139219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.140249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=0120e486c52e4ad1aecd80218b7b0b8b) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:00.140950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:00.143032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:00.156728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 123/249] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:38:59 2022] GET /identity/v3/role_assignments?user.id=0120e486c52e4ad1aecd80218b7b0b8b&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:00.173895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:00.175179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:00.187495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.265866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 127/250] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:00.290837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.329772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1359-564a-4bc2-93fa-3ee065fcb8b2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.346100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.361976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.370484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.371492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.371887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.372271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.384209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:00.395756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:00.396699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:00.397501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 124/251] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:00.402438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.416563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dfac3-fb0f-45f4-a93b-232182aa27b1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.456828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.457992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.458556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.459063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.471676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:00.481662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:00.482566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:00.483373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:00.486171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 128/252] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:00.491930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.512525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd04-1d61-43fa-8243-e92e5679658d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.564102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.564846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.565142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.565425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.566202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:00.566544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:00.567959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:00.580311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 125/253] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:00.586084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.643266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.660032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23dd90-9313-456b-9485-7cb99e714733 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.685847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.707219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.708478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.709506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.710281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.711514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:00.712047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:00.714448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:00.729133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 129/254] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:00.734919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.736925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49757-691c-4349-b2b8-d7034394d214 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.778956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.779983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.780404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.780785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.782153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:00.783752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:00.787846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 126/255] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:00.791626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:00.879342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b617-4e5b-49a6-8647-b8f77aad8265 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.966367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a06a54-3e4b-4cac-bc99-6ae593715195 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:00.969947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:00.971045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.971514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.971925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:00.973570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] PATH_INFO: `/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.977411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] RBAC: Authorizing `identity:get_user(user_id=c6d8115e4f6d487eb08f9ec390dcaf15)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:00.980952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38e611-2832-4f63-a0c5-07cec7f85abb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:00.986580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 130/256] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:00.989247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547020f-6dbb-4722-9f44-efc7df274f13 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:00.992023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547020f-6dbb-4722-9f44-efc7df274f13 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:00.992530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547020f-6dbb-4722-9f44-efc7df274f13 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:00.994204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 131/257] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:01.000320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547020f-6dbb-4722-9f44-efc7df274f13 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.048316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.049014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.049304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.049584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.124989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:01.148389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:01.150356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:01.189232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547020f-6dbb-4722-9f44-efc7df274f13 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:01.228382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.229987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.230449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.230752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.234821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:01.236352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f5a9-6780-443c-9959-0c664c3e0867 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:01.238213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 132/258] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:01.239429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.239740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.240015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.257277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:01.258469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:01.329479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 133/259] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:01.330388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.384053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:01.418668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 127/260] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:39:01.419542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.426700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:01.439067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903dd9-a6e5-4b47-9239-a38aeb8e9963 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:01.475481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.476440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.476768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.477059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/users/c6d8115e4f6d487eb08f9ec390dcaf15/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.479691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, user_id=c6d8115e4f6d487eb08f9ec390dcaf15, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:01.481154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:01.571420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 134/261] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:01 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/users/c6d8115e4f6d487eb08f9ec390dcaf15/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:01.572289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.573976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678dbf3-afe4-4a9e-92c6-a9029e355784 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:01.621385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.624049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.626045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.626573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.648413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:01.667625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:01.668578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:01.669496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:01.675966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 128/262] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:01.681752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.793096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:01.850642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f268f6-3087-4033-be13-5b1135abe80a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:01.860058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb01ce-8882-4f82-8da1-1c909f032375 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:01.873140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:01.931450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.933697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.934197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.934721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.935686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:01.936921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:01.939229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:01.944874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:01.946027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:01.946720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:01.950640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:01.956495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:01.957789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 129/263] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:01.958555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:01.960850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 135/264] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:01 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:01.962835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:01.966498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:02.151152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073b50a-c103-46f9-930a-72ce5bfdd759 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:02.155794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077679b-65cd-4ba1-956d-e87b7c4212e8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:02.201160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:02.217731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:02.219066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:02.219066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:02.219066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] PATH_INFO: `/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:02.225473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa8d9e83be44e48a5f13fbf321c3fef)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:02.226957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:02.228789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 130/265] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:01 2022] GET /identity/v3/users/7fa8d9e83be44e48a5f13fbf321c3fef => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:02.237631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:02.246136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:02.246816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:02.247106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:02.247386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:02.248233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=7fa8d9e83be44e48a5f13fbf321c3fef) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:02.248551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:02.250035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:02.266881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 136/266] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:01 2022] GET /identity/v3/role_assignments?user.id=7fa8d9e83be44e48a5f13fbf321c3fef&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:02.380641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d477-641d-4c73-9041-aa5350f7ba45 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:02.434789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:02.435865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:02.436361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:02.436891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:02.533543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:02.551344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:02.553199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:02.694319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 131/267] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:02.700274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:02.774528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:02.868639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995867-f3c8-4be2-b7fc-71cae3cc1628 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:02.923094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:02.923972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:02.924258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:02.924536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:02.925769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:02.927247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21f16-ba10-4ebe-ae42-11a1be2e94d6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:02.929959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 137/268] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:02 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:02.936476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.058822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:03.067513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef254-9b8d-4950-89d0-a0e025f325b8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.090616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408209-9eba-4a20-a2d1-ec974b29e8d0 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.091235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408209-9eba-4a20-a2d1-ec974b29e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.091952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408209-9eba-4a20-a2d1-ec974b29e8d0 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.094909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 138/269] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:03.101678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.102239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.102740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.119998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:03.121138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.121647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.122211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.124898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=7fa8d9e83be44e48a5f13fbf321c3fef) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:03.125433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:03.127083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:03.133156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:03.134814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:03.142356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 132/270] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:02 2022] GET /identity/v3/role_assignments?user.id=7fa8d9e83be44e48a5f13fbf321c3fef&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=7513e8315142426297257e9970c65752 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:03.256923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 139/271] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:03.299116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.427568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0931b9c-fc61-4b78-b594-a307a76f9ead None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.469351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:03.470505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.470997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.471503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.492728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-8604af27-065b-454e-b5b6-e86b14650299 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:03.501156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:03.502059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:03.502848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:03.510477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 133/272] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:03.512087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.566133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:03.600148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff02a4-be34-4020-8e98-99f94cfc648f None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.600687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff02a4-be34-4020-8e98-99f94cfc648f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.601183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff02a4-be34-4020-8e98-99f94cfc648f None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.603045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 134/273] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:03.610166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3619-fc89-4276-b177-9142d29c14de None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.610710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3619-fc89-4276-b177-9142d29c14de None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.611192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3619-fc89-4276-b177-9142d29c14de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.635464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f8eb3619-fc89-4276-b177-9142d29c14de None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:03.636559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f8eb3619-fc89-4276-b177-9142d29c14de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:03.647771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc104a-65c7-412b-b8fe-13b015ff6720 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.659218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:03.683707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:03.684317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.684599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.684898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.685652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:03.685961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:03.687341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff21c1-8237-421a-9e4d-57bd08da967b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:03.695881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 140/274] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:03.696936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d308-8ecb-431c-8d2b-916bb93a0891 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.697226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d308-8ecb-431c-8d2b-916bb93a0891 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.697599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d308-8ecb-431c-8d2b-916bb93a0891 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.698834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 141/275] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:03.702136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5d308-8ecb-431c-8d2b-916bb93a0891 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.718989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 135/276] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:03.720950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.721247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.721533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.741880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:03.743229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:03.817079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:03.818262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 136/277] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:03.821196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5d308-8ecb-431c-8d2b-916bb93a0891 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.825582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.857098 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:03.857989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.858278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.858558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] PATH_INFO: `/v3/users/0120e486c52e4ad1aecd80218b7b0b8b` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.859757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=0120e486c52e4ad1aecd80218b7b0b8b)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:03.861248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:03.866381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 142/278] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/users/0120e486c52e4ad1aecd80218b7b0b8b => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:03.866381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:03.916781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:03.941221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79174757-4185-44e6-8a46-a72ee0e9261f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.976960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ba72c-2c2d-4e44-8146-2678499af8c8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:03.977473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:03.978105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:03.978392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:03.979198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:03.980374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:03.981866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:03.983526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 137/279] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:03.988662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.015042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.016069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.016529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.016991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.029273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:04.037308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:04.038381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:04.039373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:04.041505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 143/280] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:04.043011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.075583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:04.100337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604eee-51f1-44e1-90a6-f95931c9a8c5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.138534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.139402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.139691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.139970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.141235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.142684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.148663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 138/281] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:03 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:04.149946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.153103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e0c1-d588-4545-9218-977c02ee442a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.165541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:04.189563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.190240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.190531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.190812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.191581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.193039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.263965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4163b-315f-407a-8e09-4d9daad0332d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.298169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.298838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.299127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.299406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.300156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:04.300465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.301888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.310595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 139/282] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:04.311502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.342968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 144/283] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:04 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:04.344133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.423775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:04.471824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:04.475586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff83de3-3fb0-478a-a448-3db9ddad0ae1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.492603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91928d02-1f4d-499e-9ae8-c85589fd4a17 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.524191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.525940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.527108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.527558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/users/0120e486c52e4ad1aecd80218b7b0b8b/roles/635966e6bee54755a655e89fdd4d1c24` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.529928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, user_id=0120e486c52e4ad1aecd80218b7b0b8b, role_id=635966e6bee54755a655e89fdd4d1c24)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.531694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028cfad-97c9-4ebe-bd7d-da2d74a7cb28 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.539580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.540815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.542483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.543713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] PATH_INFO: `/v3/users/f9815deabc954564b197a81ef2e2fcfc` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.558319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] RBAC: Authorizing `identity:get_user(user_id=f9815deabc954564b197a81ef2e2fcfc)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.559798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4a00-5537-4390-8dbc-0340a3bb8c25 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.561559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 145/284] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:04 2022] GET /identity/v3/users/f9815deabc954564b197a81ef2e2fcfc => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:04.562987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f770c-0319-4bf3-9a21-f0381cd7442a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.563275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f770c-0319-4bf3-9a21-f0381cd7442a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.563552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f770c-0319-4bf3-9a21-f0381cd7442a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.568742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 146/285] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:04.569643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f770c-0319-4bf3-9a21-f0381cd7442a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.605819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 140/286] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:04 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/users/0120e486c52e4ad1aecd80218b7b0b8b/roles/635966e6bee54755a655e89fdd4d1c24 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:04.607380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.607680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.607970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.626126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:04.627354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:04.705831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f770c-0319-4bf3-9a21-f0381cd7442a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.733131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 141/287] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:04.747136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.747869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.748208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.748493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.749430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, user.id=f9815deabc954564b197a81ef2e2fcfc, scope.system=all) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:04.749748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:04.751260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:04.757953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 147/288] 10.222.0.57 () {56 vars in 1308 bytes} [Wed May 25 14:39:04 2022] GET /identity/v3/role_assignments?user.id=f9815deabc954564b197a81ef2e2fcfc&scope.system=all&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:04.759004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.843233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:04.895849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb938-e142-49e3-9f27-039bd02ee935 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:04.940634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:04.941477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:04.941766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:04.942047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:04.954586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:04.962485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:04.963483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:04.964277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 142/289] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:04.969596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:04.989216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:05.093360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8add-2604-45b6-b3a9-e9dd87c1fc7c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:05.144084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:05.145175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:05.145689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:05.146165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:05.147117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:05.147627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:05.149289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:05.159586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 148/290] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:05.164936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:05.288490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00227df-b7cf-41a8-9b61-3aea14fac2f8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:05.315272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:05.326346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:05.327232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:05.327520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:05.327800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] PATH_INFO: `/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:05.329073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] RBAC: Authorizing `identity:get_user(user_id=c6d8115e4f6d487eb08f9ec390dcaf15)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:05.330543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:05.332444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 143/291] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:05 2022] GET /identity/v3/users/c6d8115e4f6d487eb08f9ec390dcaf15 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:05.337592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:05.442945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:05.479540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4c24-646f-45aa-aa12-dab798df7016 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:05.520196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:05.521248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:05.521682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:05.522108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:05.616903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:05.618309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:05.705836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:05.749285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 149/292] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:05.754632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:05.896879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea34b-d753-49f3-8c46-00676e995a45 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:05.935901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:05.937118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:05.937615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:05.938071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:05.939444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:05.941102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b3dc4-6386-4087-aa8c-a801d6dd878e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:05.943326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 144/293] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:05 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:05.948941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:06.140895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1928d-a96e-4663-b245-a757c1d1c498 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:06.209389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:06.209991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:06.210275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:06.210555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:06.211387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=c6d8115e4f6d487eb08f9ec390dcaf15) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:06.211702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:06.221742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a183c6-5c24-4394-9f71-c503b0eacf03 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:06.231872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 150/294] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:05 2022] GET /identity/v3/role_assignments?user.id=c6d8115e4f6d487eb08f9ec390dcaf15&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:07.216558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb36b4-4dfe-4277-9b8a-a8e0ac215318 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.216558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb36b4-4dfe-4277-9b8a-a8e0ac215318 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.216558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb36b4-4dfe-4277-9b8a-a8e0ac215318 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.216558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 145/295] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:07.222877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33866-2f75-4fda-8331-b914ae2a6163 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.223914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33866-2f75-4fda-8331-b914ae2a6163 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.224436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33866-2f75-4fda-8331-b914ae2a6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.244574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-04e33866-2f75-4fda-8331-b914ae2a6163 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:07.246356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-04e33866-2f75-4fda-8331-b914ae2a6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:07.278298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:07.322423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 151/296] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:07.347223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb36b4-4dfe-4277-9b8a-a8e0ac215318 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:07.415456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:07.419133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f7ac-c72e-4f98-b0c2-1e3187bea522 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.419435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f7ac-c72e-4f98-b0c2-1e3187bea522 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.419767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f7ac-c72e-4f98-b0c2-1e3187bea522 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.421462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 152/297] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:07.429393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587561-70de-4dc1-8047-c640e9afae15 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.429959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587561-70de-4dc1-8047-c640e9afae15 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.430445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587561-70de-4dc1-8047-c640e9afae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.448911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-14587561-70de-4dc1-8047-c640e9afae15 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:07.453209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-14587561-70de-4dc1-8047-c640e9afae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:07.471787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb36b4-4dfe-4277-9b8a-a8e0ac215318 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:07.510374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:07.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.511999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.512280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.513458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:07.514899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4943ad-8e8a-4531-90b6-f2b7d243fa5c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:07.516694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 146/298] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:07.517753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5743-8b00-40e2-a27c-eced2aee0f77 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.518066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5743-8b00-40e2-a27c-eced2aee0f77 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.518343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5743-8b00-40e2-a27c-eced2aee0f77 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.523696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 147/299] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:07.523696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb5743-8b00-40e2-a27c-eced2aee0f77 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:07.539865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 153/300] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:07.549511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.550168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.550791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.573145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:07.574594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:07.638158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb5743-8b00-40e2-a27c-eced2aee0f77 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:07.660631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 154/301] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:07.660631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:07.677789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:07.680375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:07.688953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:07.689656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.689917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.690206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] PATH_INFO: `/v3/groups` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.690890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:07.692339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:07.758182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 148/302] 10.222.0.57 () {60 vars in 1134 bytes} [Wed May 25 14:39:07 2022] POST /identity/v3/groups => generated 229 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:07.758182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:07.763540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2862-469c-4f43-b767-2913a77dcc59 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:07.805742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:07.806581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.806866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.807313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.824432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a86ab955-f6ad-4d91-a4b6-972e6e489451 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:07.835033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:07.836396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:07.837280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 155/303] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:07.839756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efcf0-2b57-4825-8d6c-03c7447a6a5b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.839756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efcf0-2b57-4825-8d6c-03c7447a6a5b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.839756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efcf0-2b57-4825-8d6c-03c7447a6a5b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.845185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 156/304] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:07.845781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36efcf0-2b57-4825-8d6c-03c7447a6a5b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:07.877656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6112-d75f-451a-a756-09e1103132c7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:07.914261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:07.915077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.915366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.915647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.927911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5555157b-3fb7-4dd4-95ca-f84acf271782 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:07.936357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:07.937329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:07.938129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 149/305] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:07.939350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:07.939444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:07.939712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:07.948738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:07.960330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:07.961618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:07.969642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36efcf0-2b57-4825-8d6c-03c7447a6a5b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.008373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.008991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.009274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.009552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.010360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:08.010667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.011943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.012050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.021088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 157/306] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.021903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.038219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 150/307] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:08.039386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.143217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4e58-e892-42fe-a732-51e7efc4a051 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.145677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425694f3-696d-40e0-a665-459fbae5a4d1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.179258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.179935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.180221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.180570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.181284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:08.182158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.182718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.183548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.183737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.184027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.184305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] PATH_INFO: `/v3/users/0120e486c52e4ad1aecd80218b7b0b8b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.185624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=0120e486c52e4ad1aecd80218b7b0b8b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.187427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.193775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 151/308] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/users/0120e486c52e4ad1aecd80218b7b0b8b => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.193775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.193964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 158/309] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.198167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.208222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.249712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.307316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced0427-e02a-49f9-8016-23a8015c5fd8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.315896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5ead-461c-4cd8-ab48-83068b32daf6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.341969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.342764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.343046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.343333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.352990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.354205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.354498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.354780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.355400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:08.364600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:08.365668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:08.366633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:08.374312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 152/310] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:08.374312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.437797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.439647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.448408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.474396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d88d-bcc4-4160-beda-dc80889b3d66 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.483966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.517692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.518586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.518876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.519148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] PATH_INFO: `/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.535630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] RBAC: Authorizing `identity:get_user(user_id=6c2756f734bb4bf8a82b6bbd69d6b230)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.537117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.538996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 153/311] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.539573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.564990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 159/312] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:08.564990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.648479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2ff3-9418-4f8c-8291-1d4dc8ebf962 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.668115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f288e01-3333-4cfe-b4fc-11caaa5947b2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.676604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.684728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.685402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.685693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.692238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.692238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:08.692238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.692238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.701664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 154/313] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.701664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.708803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.709477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.710079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.710650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.711483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, user.id=6c2756f734bb4bf8a82b6bbd69d6b230, scope.system=all) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:08.712237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.713889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.719619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 160/314] 10.222.0.57 () {56 vars in 1308 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/role_assignments?user.id=6c2756f734bb4bf8a82b6bbd69d6b230&scope.system=all&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.725958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.730515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:08.820432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614c3c-f30f-4313-85bf-503d60434a3f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.861603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.862546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.862951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.863555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.864826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.866433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.874430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 155/315] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.875758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.891083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707f31-7174-4be7-a443-2fa10daa20a6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:08.938258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:08.939270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:08.939671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:08.940026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] PATH_INFO: `/v3/users/f9815deabc954564b197a81ef2e2fcfc` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:08.941356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] RBAC: Authorizing `identity:get_user(user_id=f9815deabc954564b197a81ef2e2fcfc)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:08.942933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:08.949435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 161/316] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/users/f9815deabc954564b197a81ef2e2fcfc => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:08.950553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:08.993589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:09.013573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:09.022773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033226c-8b6e-4b5d-ac39-87a6fdc2634e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:09.061861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17682f7-e543-4b1f-a9c7-49dcf79eccfb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:09.067277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:09.068146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:09.068645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:09.069094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:09.070564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, scope.project.id=9c712be4679c49d2af8d418eb761f848, user.id=0120e486c52e4ad1aecd80218b7b0b8b) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:09.071060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:09.073289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b8f7-ec26-4f12-974f-e4a1b33c67bf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:09.081183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 156/317] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:08 2022] GET /identity/v3/role_assignments?user.id=0120e486c52e4ad1aecd80218b7b0b8b&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:09.102721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:09.104719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:09.105386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:09.105862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] PATH_INFO: `/v3/system/users/f9815deabc954564b197a81ef2e2fcfc/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:09.107762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f9815deabc954564b197a81ef2e2fcfc, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:09.109453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceed5f4-955e-488d-aa4a-a96d1e6a74c4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:09.198967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 162/318] 10.222.0.57 () {58 vars in 1334 bytes} [Wed May 25 14:39:08 2022] PUT /identity/v3/system/users/f9815deabc954564b197a81ef2e2fcfc/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:10.033960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d961-814d-4752-b202-f1f1132cb56b None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.034529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d961-814d-4752-b202-f1f1132cb56b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.034529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d961-814d-4752-b202-f1f1132cb56b None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:10.036072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 157/319] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:10.041140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.042224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.042224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:10.058401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:10.059582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:10.130666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 163/320] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:10.153925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71d961-814d-4752-b202-f1f1132cb56b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:10.271231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71d961-814d-4752-b202-f1f1132cb56b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:10.305478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:10.306194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.307013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.307288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:10.308454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:10.309917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe65a-77fc-408d-97f8-b9c7209358f2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:10.311687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 158/321] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:10.317178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:10.350230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:10.425132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaeb27-b7a9-4921-8ab3-a6e733c3e169 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:10.459801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:10.460488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.460819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.461104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] PATH_INFO: `/v3/groups` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:10.461821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:10.464278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f492f-d328-47ba-8973-bffa97b719e9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:10.567195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 164/322] 10.222.0.57 () {60 vars in 1134 bytes} [Wed May 25 14:39:10 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:10.987560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a62a8-226f-4b35-8f49-03236fefd350 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.987932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a62a8-226f-4b35-8f49-03236fefd350 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.988148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a62a8-226f-4b35-8f49-03236fefd350 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:10.989668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 159/323] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:10.996085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333668e-9276-4142-805f-b10da9406657 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:10.996698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333668e-9276-4142-805f-b10da9406657 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:10.997177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333668e-9276-4142-805f-b10da9406657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.015183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b333668e-9276-4142-805f-b10da9406657 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:11.016379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b333668e-9276-4142-805f-b10da9406657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:11.094050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 165/324] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:11.118652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a62a8-226f-4b35-8f49-03236fefd350 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:11.147194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:11.242249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a62a8-226f-4b35-8f49-03236fefd350 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:11.294762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:11.295820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.296253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.296699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.312371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:11.320383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:11.321496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:11.323044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:11.325008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:11.330992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333668e-9276-4142-805f-b10da9406657 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:11.368028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:11.460240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333668e-9276-4142-805f-b10da9406657 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:11.502903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:11.503472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.503762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.504044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.504823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:11.505138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:11.507325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510c9d-efb0-4133-b14c-9a46f90cc7ae None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:11.516921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 166/326] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:11.522416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:11.571927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2280-0364-4db8-81d7-30f216a20ca8 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.573043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2280-0364-4db8-81d7-30f216a20ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.573383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2280-0364-4db8-81d7-30f216a20ca8 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.574758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 167/327] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:11.601291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.601635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.601897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.632653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:11.633872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:11.646862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:11.672678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb99f-6d6e-4031-a79c-b9f89db5128a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:11.730592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 168/328] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:11.734692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:11.735804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.736288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.736819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] PATH_INFO: `/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.738232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] RBAC: Authorizing `identity:get_user(user_id=6c2756f734bb4bf8a82b6bbd69d6b230)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:11.739884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:11.742020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 161/329] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:11 2022] GET /identity/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:11.747835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:11.767960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:11.781694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:11.906471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8d37-d5a8-42f5-aa8a-736f31a55406 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:11.948329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:11.949263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:11.949550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:11.949834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] PATH_INFO: `/v3/system/users/6c2756f734bb4bf8a82b6bbd69d6b230/roles/635966e6bee54755a655e89fdd4d1c24` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:11.951341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6c2756f734bb4bf8a82b6bbd69d6b230, role_id=635966e6bee54755a655e89fdd4d1c24)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:11.953068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:11.996240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2547-c078-48d0-a2d5-d608a2efdc20 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:12.024948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 169/330] 10.222.0.57 () {58 vars in 1334 bytes} [Wed May 25 14:39:11 2022] PUT /identity/v3/system/users/6c2756f734bb4bf8a82b6bbd69d6b230/roles/635966e6bee54755a655e89fdd4d1c24 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:39:12.034917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:12.035805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:12.036098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:12.036373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:12.050033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:12.058768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:12.059750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:12.060548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 162/331] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:12.066625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:12.166450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:12.190699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb298a-a03e-4a21-94eb-f1cbee4a56fb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:12.229787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:12.230481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:12.230766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:12.231051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:12.232899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:12.232899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:12.234700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:12.249819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 170/332] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:12.255542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:12.275113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:12.373078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bd0e-addf-4ec1-a8b9-02e73d06482a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:12.410095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:12.410985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:12.411272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:12.411549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] PATH_INFO: `/v3/users/f9815deabc954564b197a81ef2e2fcfc` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:12.412810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] RBAC: Authorizing `identity:get_user(user_id=f9815deabc954564b197a81ef2e2fcfc)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:12.414291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a9486-ed3c-47ee-9c38-c85d3f7c17c5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:12.416064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 163/333] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:12 2022] GET /identity/v3/users/f9815deabc954564b197a81ef2e2fcfc => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:12.423295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:12.531060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0e15-5343-4a4b-a116-483789a9fb58 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:12.582725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:12.583406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:12.583695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:12.584023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:12.584897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] RBAC: Adding query filter params (role.id=e2b78b59f5d045dfbb1c6057b955be64, user.id=f9815deabc954564b197a81ef2e2fcfc, scope.system=all) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:12.585214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:12.586647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e57860-3ab7-4191-9e0c-c0aa63ee3808 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:12.599025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:12.607826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 171/334] 10.222.0.57 () {56 vars in 1308 bytes} [Wed May 25 14:39:12 2022] GET /identity/v3/role_assignments?user.id=f9815deabc954564b197a81ef2e2fcfc&scope.system=all&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:13.731902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1fdf-2d60-47b9-813d-47fe3521e65f None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:13.732445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1fdf-2d60-47b9-813d-47fe3521e65f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:13.732445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1fdf-2d60-47b9-813d-47fe3521e65f None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:13.734123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 164/335] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:13.739354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:13.739782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:13.739956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:13.761608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:13.762810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:13.853407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 172/336] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:13.903858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1fdf-2d60-47b9-813d-47fe3521e65f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:14.026479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:14.045728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1fdf-2d60-47b9-813d-47fe3521e65f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:14.088800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:14.089613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.089894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.090170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.101903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-54565d0a-805d-41e0-b707-5bdc79b521b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:14.110666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:14.111632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:14.112467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:14.115055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 165/337] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:14.122080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:14.126337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699068-2a6d-4399-9fb4-ea1dca9958c5 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.126883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699068-2a6d-4399-9fb4-ea1dca9958c5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.127173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699068-2a6d-4399-9fb4-ea1dca9958c5 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.128907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 166/338] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:14.138649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.138649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.138875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.174141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:14.175353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:14.285574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb900-2518-44cc-bbbf-923aa7902c4b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:14.324713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 167/339] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:14.336018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:14.348193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:14.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:14.364055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 173/340] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:14.365582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:14.379231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:14.485424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:14.504550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268e3b-962c-4b8d-a227-b92dc225d5f1 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:14.527112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca059-b9dd-4735-8c0f-573820c80871 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:14.549728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:14.550639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.551127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.551569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.569809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:14.570907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.571361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.571806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.586239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:14.596575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:14.597720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:14.598659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:14.600880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 168/341] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:14.609701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:14.681003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:14.713830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:14.715328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:14.752252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87add7a0-f246-4c95-a3e5-9bc54e5ef4fe None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:14.791464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:14.797816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:14.799108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.799660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.800275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.801271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:14.802650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:14.804253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084968d-c88b-4490-9c3b-9a8198688402 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:14.815758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 169/342] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:14.818526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf8434-b3b9-4525-b8f7-6c550e79b2e0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.824065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf8434-b3b9-4525-b8f7-6c550e79b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.824635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf8434-b3b9-4525-b8f7-6c550e79b2e0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.826485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 170/343] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:14.833677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:14.834611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:14.835177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:14.855286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:14.857377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:14.952957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 174/344] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:39:14.957041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.004441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 171/345] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:15.004441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.117687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.138805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafdf6-2433-413e-83c9-6c4b235049c4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.162546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49bc4-3a19-49f0-ae1e-e6597d5abc17 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.183369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.184035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.184322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.184603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.200954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.220501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.221598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.221889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.222218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.223619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:15.229791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:15.232847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 172/346] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:15.236775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.348379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:15.350432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0a98c-2281-40af-8d91-b3958698c04e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:15.430823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb609e9-8e7a-466b-bf95-40ecfd58a822 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.491471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.492667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.493136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.493594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.509421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:15.518119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:15.518276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:15.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:15.519994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:15.522427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 173/347] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:15.523568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.532460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 175/348] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:15.533888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f63a4c-354c-4450-bf6b-a2ce50d1e90d None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.534125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f63a4c-354c-4450-bf6b-a2ce50d1e90d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.534407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f63a4c-354c-4450-bf6b-a2ce50d1e90d None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.535695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 176/349] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:15.536635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f63a4c-354c-4450-bf6b-a2ce50d1e90d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.594101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.645068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb0d2e-ebe9-4b2e-894f-80c18dd3da3a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.658301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f63a4c-354c-4450-bf6b-a2ce50d1e90d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.683467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.684585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.685050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.685471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.692198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:15.693988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:15.700634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.700634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.700634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.700634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.701021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:15.701021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:15.701143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 174/350] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:15.701749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bf75e-cd0d-4348-8bdd-5340b220634f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:15.702311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.713196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 177/351] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:15.714812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebf84-73ff-442e-b4f2-442722f1bc6f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.715115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebf84-73ff-442e-b4f2-442722f1bc6f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.715396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebf84-73ff-442e-b4f2-442722f1bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.737210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-73aebf84-73ff-442e-b4f2-442722f1bc6f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:15.738460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-73aebf84-73ff-442e-b4f2-442722f1bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:15.810814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.839741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 178/352] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:15.841230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb488503-12bf-448d-a87e-11c4c86b4a06 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.841591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb488503-12bf-448d-a87e-11c4c86b4a06 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.841945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb488503-12bf-448d-a87e-11c4c86b4a06 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.842731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080f126-c8a1-4347-a83b-96aebc93333d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:15.843346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 179/353] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:15.844116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb488503-12bf-448d-a87e-11c4c86b4a06 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.861426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:15.886531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:15.887411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:15.887692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:15.887970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:15.889261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:15.891741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:15.893770 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 175/354] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:15.894616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:15.979678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb488503-12bf-448d-a87e-11c4c86b4a06 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.019971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f247ea3-893e-447e-a0b8-4a4f84c3f27f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.021526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.022218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.022512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.022794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.023662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=7513e8315142426297257e9970c65752, scope.project.id=fef5815a0fd04634bf2ef840a861e801) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:16.023977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:16.025536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72fa8a-4a14-4685-a55c-cac6d33953dc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:16.032515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 180/355] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=7513e8315142426297257e9970c65752 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:16.033807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.036128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.036532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.059460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:16.060803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:16.061461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.062207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.062491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.063044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.125348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.130368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:16.152051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:16.167258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 181/356] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:16.173584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.311847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 176/357] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:16.312740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.330808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d81476-6947-4843-8476-5ed2284b1a9c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.372871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.373969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.374405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.374831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.389835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:16.398883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:16.399793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:16.401309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 182/358] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:16.401957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.418738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.441478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d98d-9736-46a1-9a9d-e0651653b8fa None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.446342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.485815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.486924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.487211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.487493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.491533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:16.491533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0000-dfba-473c-b238-da8dde6e5f63 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:16.491927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 177/359] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:16.493201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689a35-bdda-4d28-bd8d-336fb58444f3 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.493491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689a35-bdda-4d28-bd8d-336fb58444f3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.493870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689a35-bdda-4d28-bd8d-336fb58444f3 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.496389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 178/360] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:16.497273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25689a35-bdda-4d28-bd8d-336fb58444f3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.557201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cef0-a95b-44c7-be5b-d9c45a7b7b21 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.612191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.613028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.613311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.613584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.628134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:16.638555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:16.639479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:16.640769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 183/361] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:16.641686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.644428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25689a35-bdda-4d28-bd8d-336fb58444f3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.691297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.692226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.692520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.692853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.695445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:16.697169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9862c83-a401-484c-8b03-a3ea4b30f33a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:16.699964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 179/362] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:16.701277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.701570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.701850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.719450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:16.720671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:16.737637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.779022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:16.784282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631477d-296b-4947-bebc-6d40830e97ff None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:16.814259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 180/363] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:16.815453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.839501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:16.840188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:16.840947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:16.841244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:16.842070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:16.842389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:16.843879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:16.854570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 184/364] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:16.855706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:16.950463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcd12f-c5ce-4469-92d1-8cc3b70fa779 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.005265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e11f2-a398-446b-8349-bf898494877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.006269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e11f2-a398-446b-8349-bf898494877c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.006564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4935-9286-40e6-84df-c8ed6768c38c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.007302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e11f2-a398-446b-8349-bf898494877c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.007810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e11f2-a398-446b-8349-bf898494877c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.009651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e11f2-a398-446b-8349-bf898494877c None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=fef5815a0fd04634bf2ef840a861e801) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:17.009651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e11f2-a398-446b-8349-bf898494877c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.010560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e11f2-a398-446b-8349-bf898494877c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.018373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 181/365] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.019200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e11f2-a398-446b-8349-bf898494877c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.043098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.055526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.056287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.058596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.058596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.063482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:17.063482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.063482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.074768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 185/366] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.075700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.106123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.172762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e11f2-a398-446b-8349-bf898494877c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.223471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813292-9db3-44bd-9ce8-824c384c3534 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.231995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.233257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.233782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.234271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.236148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.239379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.241974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 182/367] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.242780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.285991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.286873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.287169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.287590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.303263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:17.314401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:17.315314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:17.316107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:17.316792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 186/368] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:17.321467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.359709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.379028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165d3b-e02b-4f4e-81b5-b8f9353c1550 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.422041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.422801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.423160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.423514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.440247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.473734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c24e0f-9098-40ed-9b96-ae115ae261aa None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.528375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.529169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.529466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.529751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] PATH_INFO: `/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.530358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.530975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] RBAC: Authorizing `identity:get_user(user_id=6c2756f734bb4bf8a82b6bbd69d6b230)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.532257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.532438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.534077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 187/369] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/users/6c2756f734bb4bf8a82b6bbd69d6b230 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.534866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.625755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.645664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 183/370] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:17.646711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.651397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e33f5f-5586-4752-b1d3-633d2900b397 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.691634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.692303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.692730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.693020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.693864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=9c712be4679c49d2af8d418eb761f848) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:17.694179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.695752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.702642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 188/371] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.703569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.738528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.783831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71cfe1-6fe1-4ec9-8a72-2c24bb568de4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.859252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:17.859952 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:17.860229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:17.860507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:17.861329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:17.861636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:17.863092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:17.880360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 184/372] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:17.881309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:17.945301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:17.954018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c37b-5c19-49e1-8679-45224115f7fb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.997707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7988-a61d-442e-8ba3-2601785e570a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:17.999436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.000099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.000381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.000693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.001527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] RBAC: Adding query filter params (role.id=635966e6bee54755a655e89fdd4d1c24, user.id=6c2756f734bb4bf8a82b6bbd69d6b230, scope.system=all) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:18.001838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.003266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.018418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 189/373] 10.222.0.57 () {56 vars in 1308 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/role_assignments?user.id=6c2756f734bb4bf8a82b6bbd69d6b230&scope.system=all&role.id=635966e6bee54755a655e89fdd4d1c24 => generated 510 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:18.019280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.037455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.038626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.038919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.039243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.041980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.043681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.045773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 185/374] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:17 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:18.051233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.098374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:18.133887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a734c-dd46-4284-8c81-668980fb4248 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.168646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f6a85-0a3c-4ea9-83ef-a9d0cc22adf1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.171312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.172066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.172419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.172800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.193033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:18.209305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.216856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 186/375] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:18.224257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.258437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.260014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.338805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:18.352053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22029d-7572-4ac6-80de-373c1d01dd29 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.374435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 190/376] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:18.381588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.406012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.406609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.406900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.407179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.408030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=7513e8315142426297257e9970c65752, scope.project.id=9c712be4679c49d2af8d418eb761f848) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:18.408349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.409868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.417285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 187/377] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=7513e8315142426297257e9970c65752 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:18.495265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b74c58-9f97-4b28-8e11-2eeff188e433 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.534282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.535201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.535481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.535760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] PATH_INFO: `/v3/projects/0561c92c72f64ee9b67355671c55b3d1` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.537173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] RBAC: Authorizing `identity:get_project(project_id=0561c92c72f64ee9b67355671c55b3d1)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.538653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.544740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 191/378] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/projects/0561c92c72f64ee9b67355671c55b3d1 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:18.546684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.644055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:18.717929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981cd7-86d7-43b1-a524-6199e2bc87de None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.765541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.766412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.766701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.766980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] PATH_INFO: `/v3/groups/50f4b4afaa64456f856fb6c9fc65e248` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.774018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] RBAC: Authorizing `identity:get_group(group_id=50f4b4afaa64456f856fb6c9fc65e248)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.776028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b45aad-5692-4b97-bfbd-0a806e7ccd9b None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.778047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 188/379] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/groups/50f4b4afaa64456f856fb6c9fc65e248 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:18.784260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:18.843067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:18.910222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f94a-777d-4ad7-a7ff-0023e32f5a18 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.910541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f94a-777d-4ad7-a7ff-0023e32f5a18 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.910794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f94a-777d-4ad7-a7ff-0023e32f5a18 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.912172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 189/380] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:18.917440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4894cb-e1d6-4f3d-b942-31a4f3f3847b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:18.918939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.919305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.919661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.939923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:18.942053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:18.979938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:18.980985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:18.981446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:18.981894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:18.982918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] RBAC: Adding query filter params (group.id=50f4b4afaa64456f856fb6c9fc65e248, role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=0561c92c72f64ee9b67355671c55b3d1) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:18.983417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:18.985266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:18.996510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 192/381] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:18 2022] GET /identity/v3/role_assignments?group.id=50f4b4afaa64456f856fb6c9fc65e248&scope.project.id=0561c92c72f64ee9b67355671c55b3d1&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:19.023293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 190/382] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:19.046558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:19.191562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893fc36-2329-4215-9faa-7e440ae63b30 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:19.193428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:19.240633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:19.240633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:19.240633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:19.240633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:19.257749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:19.266655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:19.268766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:19.270732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:19.276890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 193/383] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:19.279847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:19.345935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:19.417906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ad351-0c8f-4277-82a3-527118373fb5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:19.462319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:19.463720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:19.464205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:19.464736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:19.465709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:19.466216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:19.467832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:19.481588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 191/384] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:19.487005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:19.639395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb15b17-2277-49aa-a4da-1bd1c8a97ff9 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:19.685392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:19.686288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:19.686575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:19.686854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:19.688123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:19.689617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:19.691529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 194/385] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:19 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:19.697530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:19.824303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:19.827198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434598-f576-47f3-832f-26e93b801c40 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:19.863494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:19.864910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:19.865708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:19.865990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:19.867208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:19.869532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c716c-0278-4d6e-8228-b4380ea74410 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:19.871539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 192/386] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:19 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:19.877169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:19.929212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:20.006557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f22-b089-4626-b4df-c0e8bd178b84 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.006930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f22-b089-4626-b4df-c0e8bd178b84 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.007215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f22-b089-4626-b4df-c0e8bd178b84 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.008750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 193/387] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:20.014087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357024ee-7b7c-4a7b-b13f-a691afb865cd None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:20.015022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.015374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.015664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.042778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:20.048733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:20.054674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:20.054674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.054674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.054674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/7513e8315142426297257e9970c65752` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.055799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, group_id=82ab41cc83124dd4a77973c94b29b2fe, role_id=7513e8315142426297257e9970c65752)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:20.058605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:20.133113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 194/388] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:20.158446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:20.173945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 195/389] 10.222.0.57 () {58 vars in 1442 bytes} [Wed May 25 14:39:19 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/7513e8315142426297257e9970c65752 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:20.295400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:20.301762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9f46e-d5b1-41b6-9c67-88bd453756a3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:20.341565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:20.342395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.342685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.342981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.354766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:20.362847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:20.363799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:20.364585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 195/390] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:20.370562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:20.527509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:20.546870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2726d-9dbd-48d3-b3e0-e55eeec2da6b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:20.589665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:20.590629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.591068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.591506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.592407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] RBAC: Adding query filter params (name=member) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:20.592912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:20.594433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:20.603986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 196/391] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:20.609351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:20.719326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816987-816e-4fda-84ef-38507bf6f899 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:20.754494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:20.755621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.756054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.756480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.757848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:20.759993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:20.762105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 196/392] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:20 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:20.769717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:20.901162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5406526-429a-44ed-8e47-0306e7549903 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:20.936584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:20.937525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:20.937820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:20.938102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:20.939304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:20.940796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d7327-b07e-49c2-9012-40286d97d11d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:20.942880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 197/393] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:20 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:20.949675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:20.992981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.010834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4ff2-0a5c-45a3-9697-ff76c8194ca9 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.011120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4ff2-0a5c-45a3-9697-ff76c8194ca9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.011413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4ff2-0a5c-45a3-9697-ff76c8194ca9 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.012887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 198/394] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:21.018054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.018345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.018632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.050403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:21.052002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:21.087066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.106995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f64a-143e-428c-8213-761ebf5dd687 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:21.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 199/395] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:21.180199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:21.181924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.182417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.182919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.185166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] RBAC: Authorizing `identity:create_grant(project_id=fef5815a0fd04634bf2ef840a861e801, group_id=82ab41cc83124dd4a77973c94b29b2fe, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:21.186836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:21.196739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:21.254601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 197/396] 10.222.0.57 () {58 vars in 1442 bytes} [Wed May 25 14:39:20 2022] PUT /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:21.316535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199236b-dd3a-42bc-9afc-b896f62ff452 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:21.354968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e2666-e212-4780-8792-572c528ae051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:21.355782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e2666-e212-4780-8792-572c528ae051 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.356126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e2666-e212-4780-8792-572c528ae051 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.356417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e2666-e212-4780-8792-572c528ae051 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.367926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e2666-e212-4780-8792-572c528ae051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-554e2666-e212-4780-8792-572c528ae051 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:21.376394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:21.377378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:21.378169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 200/397] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:21.384571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:21.510704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.528734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe21d-f45d-46a6-a391-6cb96ab99978 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:21.563881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:21.564650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.564947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.565467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.566407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:21.567111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:21.568501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f1d8b-405f-460c-af3d-1352d874f959 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:21.578379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 198/398] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:21.584048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e2666-e212-4780-8792-572c528ae051 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:21.598034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.669960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78cf2-f291-49e2-bc31-feb8de5157ea None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.670525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78cf2-f291-49e2-bc31-feb8de5157ea None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.671003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78cf2-f291-49e2-bc31-feb8de5157ea None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.672558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 199/399] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:21.677841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.678333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.678784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.702577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e2666-e212-4780-8792-572c528ae051 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:21.705163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:21.707352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:21.767645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:21.769014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:21.771041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:21.772212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:21.774646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:21.778084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:21.780539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 201/400] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:21 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:21.786113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:21.832738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 200/401] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:21.850941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:21.939841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.965443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1287b8-a58d-4392-ba3b-c3dda0373f2f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:21.972640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:21.998467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789f39-f964-4b03-97b9-1198fff5fc96 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.033950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.035096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.035575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.036044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.045135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.045994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.046281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.046557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.047756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.051253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.051253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 202/402] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:21 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:22.056491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.065202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-a9d3955b-3b73-4bfd-a43d-a5b77017f9b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:22.074492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:22.075435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:22.076224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:22.083227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 201/403] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:22.084860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b357f-99c2-4189-8d46-ae3c98fbefd0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.085352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b357f-99c2-4189-8d46-ae3c98fbefd0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.085850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b357f-99c2-4189-8d46-ae3c98fbefd0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.088135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 202/404] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:22.093259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b357f-99c2-4189-8d46-ae3c98fbefd0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.181864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996b20-0b71-4adf-ac57-874530c32076 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.198935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b357f-99c2-4189-8d46-ae3c98fbefd0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.230193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.233190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.233685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.234202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.238285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, group_id=82ab41cc83124dd4a77973c94b29b2fe, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.239995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.248780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.249920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.250403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.250889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.251988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:22.252559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.258945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dbbf8-8c74-425d-9e5a-4ffcc5300ec9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.261138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:22.270421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 203/405] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:22.270421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.270421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.270421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.290171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:22.290171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:22.347766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 203/406] 10.222.0.57 () {58 vars in 1442 bytes} [Wed May 25 14:39:22 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:39:22.349111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.372206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:22.374559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 204/407] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:22.412333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.579541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888699d-7467-43fe-b6ad-6fb553915569 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.591744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee3547-aea2-4d82-914c-03d43c8a55b7 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.620103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:22.630391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.631517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.631889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.632236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.640131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.641543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.642261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.642716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.644088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.645951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:22.646378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.652695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 204/408] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:22.654324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:22.655222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:22.656178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 205/409] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:22.657089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.663493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.754886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:22.778074 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d874-e4ba-4556-a2dc-de5fb98957f4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.781465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec59c-0cc6-4752-ba70-a7bd835a9e5b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.816210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.817241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:22.817532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.818004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.818472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.818659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:22.818909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:22.819323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:22.820008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:22.820517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.821127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:22.823466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.823924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:22.831251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 205/410] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:22.833502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.841024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 206/411] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:22.851295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:22.911808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:22.963882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53fbe-6432-4f5c-8802-a3c93db87b60 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:22.987888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83382e0-a16d-4c06-9f3a-d9ae62178d07 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:23.004265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.005631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.006128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.006596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] PATH_INFO: `/v3/groups/50f4b4afaa64456f856fb6c9fc65e248` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.008083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] RBAC: Authorizing `identity:get_group(group_id=50f4b4afaa64456f856fb6c9fc65e248)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:23.009888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:23.016579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 207/412] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:22 2022] GET /identity/v3/groups/50f4b4afaa64456f856fb6c9fc65e248 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:23.021992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:23.062878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.064347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.066054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.066566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/7513e8315142426297257e9970c65752` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.074180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] RBAC: Authorizing `identity:create_grant(project_id=9c712be4679c49d2af8d418eb761f848, group_id=82ab41cc83124dd4a77973c94b29b2fe, role_id=7513e8315142426297257e9970c65752)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:23.075904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e8ee-9c42-41c9-8b02-b6bc2b0851ff None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:23.164022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f7f-e148-4d2d-885b-bbbe1cb19ab5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:23.175889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 206/413] 10.222.0.57 () {58 vars in 1442 bytes} [Wed May 25 14:39:22 2022] PUT /identity/v3/projects/9c712be4679c49d2af8d418eb761f848/groups/82ab41cc83124dd4a77973c94b29b2fe/roles/7513e8315142426297257e9970c65752 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:39:23.201444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:23.221532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb86cb-d137-44c1-a16b-0df755abb837 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.222031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb86cb-d137-44c1-a16b-0df755abb837 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.222031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb86cb-d137-44c1-a16b-0df755abb837 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.224871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 207/414] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:23.229982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751e24-31df-459f-ae14-fcde343caddd None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.230277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751e24-31df-459f-ae14-fcde343caddd None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.230563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751e24-31df-459f-ae14-fcde343caddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.232415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.233383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.233670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.233947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] PATH_INFO: `/v3/projects/0561c92c72f64ee9b67355671c55b3d1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.235300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] RBAC: Authorizing `identity:get_project(project_id=0561c92c72f64ee9b67355671c55b3d1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:23.236811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:23.243914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 208/415] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:23 2022] GET /identity/v3/projects/0561c92c72f64ee9b67355671c55b3d1 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:23.245316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:23.246790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:23.273786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-23751e24-31df-459f-ae14-fcde343caddd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:23.284787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-23751e24-31df-459f-ae14-fcde343caddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:23.363013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7a3a1-7d6b-452b-9788-f65b5da44ffe None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:23.403148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.403987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.404340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.404714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] PATH_INFO: `/v3/projects/0561c92c72f64ee9b67355671c55b3d1/groups/50f4b4afaa64456f856fb6c9fc65e248/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.406865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] RBAC: Authorizing `identity:create_grant(project_id=0561c92c72f64ee9b67355671c55b3d1, group_id=50f4b4afaa64456f856fb6c9fc65e248, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:23.408512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:23.429459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 208/416] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:23.454363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751e24-31df-459f-ae14-fcde343caddd None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:23.489360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 209/417] 10.222.0.57 () {58 vars in 1442 bytes} [Wed May 25 14:39:23 2022] PUT /identity/v3/projects/0561c92c72f64ee9b67355671c55b3d1/groups/50f4b4afaa64456f856fb6c9fc65e248/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:39:23.576361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751e24-31df-459f-ae14-fcde343caddd None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:23.609515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:23.614964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.615797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.616079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.616351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.627641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:23.637129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:23.638096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:23.638903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:23.643301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 209/418] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:23.644798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:23.718644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:23.782120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacb0b-a162-49bd-aa55-45bc95e91267 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:23.825426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:23.826127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.826412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.826694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.827476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:23.827789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:23.829223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77882c-a265-4e0c-a1c4-bf263d432012 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:23.839209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 210/419] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:23.849046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:23.895324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca028-4ded-4187-bc5f-062afefe6be2 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.895613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca028-4ded-4187-bc5f-062afefe6be2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.895901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca028-4ded-4187-bc5f-062afefe6be2 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.898147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 211/420] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:23.902480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:23.902768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:23.903051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:23.925748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:23.928670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:23.982484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450d3d-f8cf-411f-97a3-7a60e0b41bac None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.037216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 212/421] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:24.054378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.055063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.055404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.055696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.070774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.117450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.186493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5967-601b-442e-891b-11bdf616b9e1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.227126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.228469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.232702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.232702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.236966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.253245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:24.260753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:24.260862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:24.267484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:24.268390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:24.269227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 213/422] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:24.274436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.437966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.441883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019a1e-6e54-41a8-9227-c9fd356798ee None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.461057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 210/423] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:24.477230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.483317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.483928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.484255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.484539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.485327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:24.486488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:24.488900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:24.499522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 214/424] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:24.506535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.665881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.677927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b187-9ce4-4d84-af47-2913651aa569 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.709556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123f33-6e20-4348-800a-50a2b48d686a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.743142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.744486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.744968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.745247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.749165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:24.750622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:24.752513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 211/425] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:24.760030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.778983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.779636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.779918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.780192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.831627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.896700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:24.898173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:24.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868338-32a2-4561-a7a8-913a85cef647 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:24.997218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:24.997994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.998277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.998554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.999817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.001270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.005088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 212/426] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:25.010455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.080982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.107527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 215/427] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:25.122995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.148794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf375e-064c-4e40-842c-d488c28e3a86 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.186736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.187534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.187830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.188120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.189002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=7513e8315142426297257e9970c65752, scope.project.id=fef5815a0fd04634bf2ef840a861e801) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:25.189320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.190929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562ef0e-23d7-48b7-9734-62d50ece44d9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.198652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 213/428] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=7513e8315142426297257e9970c65752 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:25.218840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e2fe-9420-4ba2-8d01-9a2539ae4b81 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.219413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e2fe-9420-4ba2-8d01-9a2539ae4b81 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.219871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e2fe-9420-4ba2-8d01-9a2539ae4b81 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.221730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 214/429] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:39:25.227713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.228474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.228977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.246538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.271794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:25.275217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:25.342914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058fe9-7c25-40c9-9aff-6f2636ae2cce None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.420197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.421106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.421394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.421671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] PATH_INFO: `/v3/projects/fef5815a0fd04634bf2ef840a861e801` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.422464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 215/430] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:25.422887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] RBAC: Authorizing `identity:get_project(project_id=fef5815a0fd04634bf2ef840a861e801)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.424341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.427584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 216/431] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/projects/fef5815a0fd04634bf2ef840a861e801 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:25.433573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.453720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.458755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.585754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7188fb-653d-4215-8322-f18ef47f5f12 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.597250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ab6a-f770-4924-957c-c5f7912fcc88 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.625029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.625927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.626453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.626735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.628069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.630164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.632529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 216/432] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:25.639202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.639916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.645959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.647144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.648130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.659405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:25.668866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:25.669767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:39:25.670573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:25.673283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 217/433] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:25.679087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.741544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.750055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7efa21-8373-49f5-b426-e2d5aa6d9cdf None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.785797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46a12-c4a5-4450-b167-82e485576b2b None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.790836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.791734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.792019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.792294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.793154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=fef5815a0fd04634bf2ef840a861e801) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:25.793472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.794912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37039db-63c6-489c-88d1-520e1d8b3482 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.801074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 217/434] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=fef5815a0fd04634bf2ef840a861e801&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:25.808433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40e62-6785-4515-b5b1-b63406f0c81c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.808433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40e62-6785-4515-b5b1-b63406f0c81c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.808433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40e62-6785-4515-b5b1-b63406f0c81c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.808433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 218/435] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:25.810051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.810348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.810635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.831327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:25.832562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:25.832911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.833603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.833896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.834180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.834959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] RBAC: Adding query filter params (name=member) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:25.835277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.839072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.847681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 218/436] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:25.855717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:25.930703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:25.937812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 219/437] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:25.961154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.001165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721799-ab5f-41d5-8121-d37c90c37d32 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.052221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.052221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.052221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.052221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.073007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.094325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a3cc-4be9-4f9a-964c-6ac916961926 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.138073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.138898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.139185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.139465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.145500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.147807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee50ea-77b2-440a-b69c-2999ca9629c9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.153189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:26.161805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:26.162706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:26.163574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:26.167795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 220/438] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:26.173490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.219913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.292325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 219/439] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:26.294467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54474cfa-4d10-45a0-84a3-d7039a0eaf08 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.295001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54474cfa-4d10-45a0-84a3-d7039a0eaf08 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.295495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54474cfa-4d10-45a0-84a3-d7039a0eaf08 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.297299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 220/440] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:26.298168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54474cfa-4d10-45a0-84a3-d7039a0eaf08 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.328713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1fd42-233e-426b-b1bf-b8b552cce97b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.371748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.372699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.372838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.373505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.373844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:26.374152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.375523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456294a-c609-4a80-8153-a71eb42fafdc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.385439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 221/441] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.386782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.387078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.387359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.401030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.409795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:26.411131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:26.439041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54474cfa-4d10-45a0-84a3-d7039a0eaf08 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.479437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.480295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.480577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.480884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.482074 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.483503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.485645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 221/442] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.486415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.489092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 222/443] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:26.497758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.509945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.605592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df8ce-18ca-4528-a6dc-c47d1f098a09 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.608885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7367f-6759-47e3-b885-e5b336b488d5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.640312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.640918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.641217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.641503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.643108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.644010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.644246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.644526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.645739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.647179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.648824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 223/444] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.650144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.654415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.710501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.712080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.732894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.751315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1a88e-0691-47f2-99c5-906f8cb67996 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.784762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.785539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.785822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.786093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.796692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:26.804492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:26.805612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:26.807063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 224/445] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:26.807863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.817302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 222/446] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:26.818127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.874498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.920176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611e76-2c08-4282-b1fa-2c761044ddce None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.922234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9e7e-2cbe-488d-8635-6c8850b77fbc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.948123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:26.955750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.956410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.956781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.957066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.957904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=e2b78b59f5d045dfbb1c6057b955be64, scope.project.id=9c712be4679c49d2af8d418eb761f848) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:26.958224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.959797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.966085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 225/447] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=e2b78b59f5d045dfbb1c6057b955be64 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.966658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.966753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.967426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.967710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.967995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.968770 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:26.969087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.970481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.984226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 223/448] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.985851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.086390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab681-ae2d-420a-adc9-0f3694c024e2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.109258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47bbb8-ba15-4f2d-81c4-be09d2549f4c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.116309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:27.125533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.127050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.132058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.132058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] PATH_INFO: `/v3/projects/9c712be4679c49d2af8d418eb761f848` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.132058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=9c712be4679c49d2af8d418eb761f848)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.132058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.132476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 226/449] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/projects/9c712be4679c49d2af8d418eb761f848 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:27.138565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.149867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.150535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.150827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.151106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.213337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:27.241167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.244391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.259547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c710-38f7-4293-94e4-5de0e78ba1a7 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.297753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.298622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.298908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.299188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] PATH_INFO: `/v3/groups/82ab41cc83124dd4a77973c94b29b2fe` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.301280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] RBAC: Authorizing `identity:get_group(group_id=82ab41cc83124dd4a77973c94b29b2fe)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.303217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.304876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 227/450] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:27 2022] GET /identity/v3/groups/82ab41cc83124dd4a77973c94b29b2fe => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:27.311345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.369203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 224/451] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:39:27.375237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.384901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:27.423390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732333-bde7-4401-b01d-8610bd9fee9c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.456808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:27.457181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.457827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.458111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.458388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.459218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] RBAC: Adding query filter params (group.id=82ab41cc83124dd4a77973c94b29b2fe, role.id=7513e8315142426297257e9970c65752, scope.project.id=9c712be4679c49d2af8d418eb761f848) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:27.459528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.460993 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.467431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 228/452] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:27 2022] GET /identity/v3/role_assignments?group.id=82ab41cc83124dd4a77973c94b29b2fe&scope.project.id=9c712be4679c49d2af8d418eb761f848&role.id=7513e8315142426297257e9970c65752 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:27.476489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e26d1-37b4-4d98-8e63-223ae4c24b8a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.513224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.514098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.514380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.514653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] PATH_INFO: `/v3/projects/0561c92c72f64ee9b67355671c55b3d1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.515865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] RBAC: Authorizing `identity:get_project(project_id=0561c92c72f64ee9b67355671c55b3d1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.517357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.519076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 225/453] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:39:27 2022] GET /identity/v3/projects/0561c92c72f64ee9b67355671c55b3d1 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:27.525403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.630730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29635-d179-4047-8400-5104dd6b81ac None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.658811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:27.667539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.668405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.668720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.669006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] PATH_INFO: `/v3/groups/50f4b4afaa64456f856fb6c9fc65e248` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.670173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] RBAC: Authorizing `identity:get_group(group_id=50f4b4afaa64456f856fb6c9fc65e248)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.671615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f9139-f569-4dfa-9825-54e5bdf5d7ff None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.673309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 229/454] 10.222.0.57 () {56 vars in 1180 bytes} [Wed May 25 14:39:27 2022] GET /identity/v3/groups/50f4b4afaa64456f856fb6c9fc65e248 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:27.679251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:27.781570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395ab0d-4c9b-4a12-bb68-a6b17f808c2e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:27.815606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:27.816259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:27.816543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:27.816848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:27.817680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] RBAC: Adding query filter params (group.id=50f4b4afaa64456f856fb6c9fc65e248, role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=0561c92c72f64ee9b67355671c55b3d1) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:27.817987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:27.819414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911fb3c-cd46-4095-9a64-736f6960515c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:27.825529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 226/455] 10.222.0.57 () {56 vars in 1376 bytes} [Wed May 25 14:39:27 2022] GET /identity/v3/role_assignments?group.id=50f4b4afaa64456f856fb6c9fc65e248&scope.project.id=0561c92c72f64ee9b67355671c55b3d1&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:30.599319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648f1f-bc72-4feb-861a-7cc17c73f493 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:30.600299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648f1f-bc72-4feb-861a-7cc17c73f493 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:30.600848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648f1f-bc72-4feb-861a-7cc17c73f493 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:30.602715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 230/456] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:30.608339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:30.609249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:30.609736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:30.633576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:30.635859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:30.648280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6027b4-1005-4bc1-bbf6-54def412a7d3 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:30.648940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6027b4-1005-4bc1-bbf6-54def412a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:30.649962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6027b4-1005-4bc1-bbf6-54def412a7d3 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:30.651782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 231/457] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:30.655853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:30.657412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:30.657979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:30.658463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:30.686348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:30.689476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:30.774024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 227/458] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:30.781043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 232/459] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:30.805881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:30.823184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:30.950176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86de5e7-4f7d-45c6-8a4b-8aaf034bcfd3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:30.997261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:30.998095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:30.998376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:30.998647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.028642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.030232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.046156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed17d4d-d5e2-4366-9139-fac40fbe9064 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.055530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:31.064320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:31.065736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:31.066787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:31.066787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:31.066787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.066787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:31.068514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 228/460] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:31.074823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.103025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.123000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.124360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.124830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.125274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.146970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.148834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3c12db87-b820-48be-b239-8305618d1827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:31.169004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:31.170083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:31.171091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:31.171091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:31.171091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.171091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:31.172926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 233/461] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:31.174455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b58-a253-4cf1-8a35-042ec53de0c6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.174974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b58-a253-4cf1-8a35-042ec53de0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.175455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b58-a253-4cf1-8a35-042ec53de0c6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.176996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 234/462] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:31.182084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042b58-a253-4cf1-8a35-042ec53de0c6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.208503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80fa6-02cc-4e33-a939-ada51115142c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.246560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.247224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.247626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.247905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.248783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:31.249096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.250586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5bff9-cc1b-4042-b0fd-74bfa39cc99e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.268589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 229/463] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:31.269869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.270163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.270560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.287875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:31.289079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:31.296266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042b58-a253-4cf1-8a35-042ec53de0c6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.331624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.332295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.332590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.332900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.333625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:31.333933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.335309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c5ff-3c1e-42a5-8e9c-732bf21a8617 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.342243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.348026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 235/464] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:31.356763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d366b4-2c88-4f38-9692-08a7add54223 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.356763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d366b4-2c88-4f38-9692-08a7add54223 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.356763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d366b4-2c88-4f38-9692-08a7add54223 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.356763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 236/465] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:31.356763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d366b4-2c88-4f38-9692-08a7add54223 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.380638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 230/466] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:31.380638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.423378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.477297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a327e-8430-4575-bdfb-01c2b4fdccf9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.487951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d366b4-2c88-4f38-9692-08a7add54223 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.514345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.515255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.515842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.516356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.517281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.518935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cef15-2d89-40bb-bfb6-9062fb05c5de None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.521135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.521791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.522075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.522351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.523044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.525021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.629550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 231/467] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:31 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:31.630820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.631110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.631393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.656309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:31.659965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:31.667019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 237/468] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:31 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:31.669294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.757310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.841309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 232/469] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:31.866502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:31.874983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:31.883612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4922223-2116-4707-a03d-5f1c89045cdc None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:31.926722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:31.927558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.927844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.928579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.942816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:31.944307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-84ca21ea-34d6-4c2f-be2f-70ab4a10ff08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:31.966723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:31.967611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:31.968468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:31.968468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:31.968468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:31.968468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:31.970716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 238/470] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:31.972205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed811da4-fe14-4cb4-a3ba-10d62bc7f60b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:31.972765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed811da4-fe14-4cb4-a3ba-10d62bc7f60b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:31.973249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed811da4-fe14-4cb4-a3ba-10d62bc7f60b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:31.974769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 239/471] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:31.976129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed811da4-fe14-4cb4-a3ba-10d62bc7f60b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.016305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94770015-9037-4ef9-ada1-11922eadb70c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.051819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.052826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.053000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.053280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.064634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.066228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f39ec4f5-6941-4b9d-965f-9f022d01b023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:32.084702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:32.085597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:32.086431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:32.086431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:32.086431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:32.086431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.086431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 233/472] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:32.092080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.092080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.092080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.109963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:32.111152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:32.116813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed811da4-fe14-4cb4-a3ba-10d62bc7f60b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.130360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:32.165231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.166702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.167560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.168011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.168931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:32.169413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.171796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.185381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 234/473] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:32.186347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.188262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 240/474] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:32.197665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.210334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:32.322416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dc24a-01ea-4beb-a7d6-b3ce27dd0d71 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.336145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072882fa-eef2-40c2-8fbd-c6b268ab22e9 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.370221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.371032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.371323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.371598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.372335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:32.372671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.375454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.378769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.379602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.380058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.380448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.381300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.382842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.392904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 235/475] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:32.394568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.411920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:32.460708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 241/476] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:32 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:32.462623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.550628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:32.574967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e334a-ac04-4dfe-9b62-2d94aef3178d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.604598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5f5a-4586-4576-a16a-062a4beca1cc None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.654607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.655851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.656289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.656743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.657612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.659297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.664545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.665810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.666354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.666681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.667450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:32.668848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:32.731142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.sql.core [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:39:32.731142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:39:32.731142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [parameters: {'id': '8afd9f0300244f148ac22796665f8363', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:39:32.731142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86823) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:39:32.746009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 242/477] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:32 2022] POST /identity/v3/users => generated 249 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application conn.query(q) May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application result.read() May 25 14:39:32.756037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return ref.to_dict() May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:39:32.757213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application next(self.gen) May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application yield resource May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application next(self.gen) May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise self.value May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application session.commit() May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:39:32.758360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.session.flush() May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application compat.raise_( May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:39:32.760154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:39:32.761208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application conn.query(q) May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application result.read() May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:39:32.762114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [parameters: {'id': '8afd9f0300244f148ac22796665f8363', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:32.762897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:39:32.763696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:32.766156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 236/478] 10.222.0.57 () {60 vars in 1131 bytes} [Wed May 25 14:39:32 2022] POST /identity/v3/roles => generated 144 bytes in 373 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:32.772559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:32.899521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6bc2b-6131-4c99-9067-163817b13843 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:32.925410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:32.950497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:32.951351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:32.951645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:32.951933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:32.968239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-f6d77212-a8eb-4cf3-be05-46689a5bd5a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:32.976636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:32.978144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:32.979056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 243/479] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:39:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:32.984913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:33.081192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:33.104470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33009-818d-40b2-b186-5ad336c2a6cd None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:33.150908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:33.151518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:33.151892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:33.152179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:33.152974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:33.153288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:33.154664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474d4b-49a1-432f-9e16-e2a09796f975 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:33.163788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 237/480] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:34.173080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f287d-ec79-4c61-9c7f-b2afb61aca23 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.173611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f287d-ec79-4c61-9c7f-b2afb61aca23 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.173938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f287d-ec79-4c61-9c7f-b2afb61aca23 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.175715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 244/481] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:34.181606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464823-2838-4166-ae33-ba7afc597478 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.182084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464823-2838-4166-ae33-ba7afc597478 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.182372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464823-2838-4166-ae33-ba7afc597478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.200428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-64464823-2838-4166-ae33-ba7afc597478 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:34.201666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-64464823-2838-4166-ae33-ba7afc597478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:34.278148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 238/482] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:34.307728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ae15c-ee5c-4d37-92ed-b06326cef8ee None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.308025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ae15c-ee5c-4d37-92ed-b06326cef8ee None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.308290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ae15c-ee5c-4d37-92ed-b06326cef8ee None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.309930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 245/483] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:34.315106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.315405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.315693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.337940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:34.339262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:34.354129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ae15c-ee5c-4d37-92ed-b06326cef8ee None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:34.428431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:34.440928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 239/484] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:34.474566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:34.547479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ae15c-ee5c-4d37-92ed-b06326cef8ee None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:34.590104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e90bf-6b9f-4ee5-8c1d-89ebc23a34b3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:34.628851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:34.629655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.629942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.630217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.633307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:34.634707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.634984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.635254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.645142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:34.653593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:34.654509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:34.655330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 240/485] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:34.660242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:34.660404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:34.677635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:34.678809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:34.679892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:34.682640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 246/486] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:34.688641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:34.740968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:34.771035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:34.830984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0cfd-944a-48fd-a867-118ae6ac3a54 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:34.875993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:34.877116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.877407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.877688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.878443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:34.878761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:34.880146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:34.889245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 241/487] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:34.890604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889ca76-2506-48a4-826e-dedce643de1d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:34.894573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:34.987137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:34.987732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:34.988013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:34.988285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:34.989068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:34.989438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:34.991753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.014917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 247/488] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:35.018425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.094059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0e9e5-4e4d-40f1-bae4-e57f600742af None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.136997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.163736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.164540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.168403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.168403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.189439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.190909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.209549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.218495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924bd8a-6af0-4d76-a750-f9fce179502e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:35.226930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:35.231736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:35.232594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:35.232594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:35.232594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:35.232594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:35.232594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 242/489] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:35.239453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.294503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.295327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.295612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.295891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.322814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.324311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:35.353176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:35.354216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:35.355518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:35.355518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:35.355518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:35.355518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:35.355518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 248/490] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:35.361375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.389725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad831-63a8-4cdf-8675-c30f62eba644 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.471597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.472276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.472560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.472861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.473720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:35.474093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.475460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.476635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836549-dd36-4b84-b381-98d785844c0d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.505922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 243/491] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:35.511381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.512320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.513041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.513330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.513612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.514347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:35.514660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.516057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.528454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 249/492] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:35.533702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.564962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.587417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.658718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c231-68d7-4f9d-a7c9-2ad9d5ee304a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.675289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088314d-07ca-4dd7-b7bb-e9fcc8b6957c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.694002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.694801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.695095 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.695380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.703949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.705445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.712855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.713659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.713941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.714215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] PATH_INFO: `/v3/users/glance` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-fc20f303-fda5-4b3f-9970-472ed8a75191 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:35.720756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:35.721674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:35.722581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 250/493] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:35.724448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.725937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.728189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee93e8-7086-4c59-995c-b5a24e7b16ce None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.729011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee93e8-7086-4c59-995c-b5a24e7b16ce None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.730115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee93e8-7086-4c59-995c-b5a24e7b16ce None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.735786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 251/494] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:35.737314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090fa13-cc80-431c-93b1-d6a36ed08095 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.737612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090fa13-cc80-431c-93b1-d6a36ed08095 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.737885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090fa13-cc80-431c-93b1-d6a36ed08095 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.739248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 252/495] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:35.743748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090fa13-cc80-431c-93b1-d6a36ed08095 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-dba9d1ea-9156-4ec2-8823-4bd1af743fff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:35.745855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:35.746710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 244/496] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462e9-065f-49a0-b0f8-dfa04a7ab3e0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.752343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462e9-065f-49a0-b0f8-dfa04a7ab3e0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.753057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462e9-065f-49a0-b0f8-dfa04a7ab3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.768322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b37462e9-065f-49a0-b0f8-dfa04a7ab3e0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:35.769480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b37462e9-065f-49a0-b0f8-dfa04a7ab3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:35.820102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.843825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 245/497] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:35.849926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.850263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.850581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.854157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090fa13-cc80-431c-93b1-d6a36ed08095 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:35.872389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:35.873681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:35.899174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:35.905115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:35.906120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:35.906470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:35.906759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:35.907636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:35.907957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:35.909496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:35.949975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 253/498] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:35.955612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:35.956931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 246/499] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:35.957946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.065849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb92b5c-e7da-47d5-9e4b-6a08942ff8aa None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.080499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c33f3-2031-46a1-9053-2626ef6943a4 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.096232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.101858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.102746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.103041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.103322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.104159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:36.104474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.105951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.114653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.115455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.115742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.116021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.123403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 254/500] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:36.124205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.131841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:36.140348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:36.141440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 247/501] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:36.142570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.157965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.229477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ac6b-3f87-44b4-bc6a-508b772220a4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.241604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a6316-2f9a-4d61-8f21-f5f6c814a496 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.263433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.264084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.264372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.264692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.274936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.275732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.276021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.276306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.286348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-dda880f2-ea41-4e6e-9308-dcd00e601921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:36.295022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:36.295913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:36.296903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 248/502] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:36.298020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23969469-e9de-47b8-8aa9-c811c511b5b2 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.298020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23969469-e9de-47b8-8aa9-c811c511b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.298160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23969469-e9de-47b8-8aa9-c811c511b5b2 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.299524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 249/503] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:36.300041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23969469-e9de-47b8-8aa9-c811c511b5b2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.328585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.340706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.342201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.376566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.401831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23969469-e9de-47b8-8aa9-c811c511b5b2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.436451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.437144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.437465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.437749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.441382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 255/504] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:36.442303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.507260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.509587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3f59a-e0c6-464d-b017-994310e443e9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.527866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.539749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cbaae-a9ca-4f0a-a7e0-7373057da146 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.575730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.576396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.576714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.576998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.577740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:36.578052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.579483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.586018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.588208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 256/505] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:36.589031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.612282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 250/506] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:36.613614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.614094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.614556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.630889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:36.632087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:36.691007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcba3c-0a98-4b6e-a0d1-1cc6bde78a0b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.700362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 251/507] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:36.701236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.724865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.725542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.725831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.726113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.726866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:36.727180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.729211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.737290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 257/508] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:36.738069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.754046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.804336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f009-7ff3-4a4a-bea5-10a7728aab28 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.806656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.838892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.839208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351dea-d40c-4312-88fd-32a42bc1b0a3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.839669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.840053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.840338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.851402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.853502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:36.872137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:36.873033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:36.874051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:36.874051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:36.874051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:36.874051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:36.874051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 252/509] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:36.874581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.876751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.877674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.878072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.878462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.889600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.891068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:36.909484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:36.910511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 258/510] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:36.911537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.977211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.977631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355cf8-7ddb-47cb-b574-c7b98396ff5d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.011367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.012160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.012442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.012743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.014802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822dd3-8b1a-4175-b998-fb3d9e476512 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.022629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.024760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:37.042340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.043318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.044219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:37.044219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:37.044219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.044219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:37.044219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 253/511] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.044750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.049431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.050252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.050542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.050829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.054906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.061074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.062539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:37.080253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.081159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.081992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:37.081992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:37.081992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.081992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:37.081992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 259/512] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.082524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.159274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc2a-e0de-4f04-8659-1aa54826eedc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.188224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e728-6217-459d-bb8c-5450f742ba7d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.201983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.203199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.203602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.203998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.204918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.215361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.219835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.223007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.223675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.223966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.224248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.225013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:37.225324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.226699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:37.235543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.236450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 254/513] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.237836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.241750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 260/514] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:37.242584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.301454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.341966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554092cb-20c6-466b-9cb7-42f3aad436e6 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.343287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad224d9e-49ab-456b-99c0-9e05fa11c4e8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.378019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.378682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.378974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.379254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.379989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:37.380295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.381701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.382042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.382709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.383048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.383323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.384110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:37.384409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.385805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.393075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 255/515] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:37.393882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.401547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 261/516] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:37.402371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.440402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.504386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af92e-0169-46d3-98c8-30fcc3c414e5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.510970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329ecc-f679-4d06-8593-fa867a9b1190 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.526990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.541609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.542277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.542562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.542834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.543551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:37.543856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.545250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.546348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.547014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.547305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.547715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.548468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:37.548815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.550174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.556875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 256/517] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:37.557670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.570451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 262/518] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:37.570451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.658994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67507d-f128-4321-ae8f-77f0ebea581f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.660405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.667870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10021-708a-4776-b07b-1fded17da33b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.692951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.693679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.693966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.694246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.701448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.702897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.703508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.704301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.704601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.704911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.712824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.714922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:37.717513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.718569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:37.719473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 257/519] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.719959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:37.729937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.730880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 263/520] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.731917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.768244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.824808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06aa6b-1afc-411f-967f-417b9ed1162c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.830986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64f77-fed2-4a16-927a-26206f1af5f3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.857966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.858752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.859037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.859316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.865222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.867108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.867325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.867325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.867325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.867325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.867627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.869133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:37.881935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:37.889458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 258/521] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:37.898547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.962316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 264/522] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:37 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:37.962316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.979973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.985154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:37.988459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9b33-3e22-416e-a17e-2897f47f9a20 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.029688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.030510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.030800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.031077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.039274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.041778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:38.058532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:38.061900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 259/523] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:38.062810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.083755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71ccd-377d-408d-8cc9-6cbe9dc3b749 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.124180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.124987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.125334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.125707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.126574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.126946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.128497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.149522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 265/524] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.149864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.179919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be8a3-fe0f-4e55-a7a2-23a862f6e0c7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.222606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.223211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.223495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.223776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.224637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.224955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.226399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.230092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.263217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983df5-d445-4183-b39c-7f4da67847b6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.268746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 260/525] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.268746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.287503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.303708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.304464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.304854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.305142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.306851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.307174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.308706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.323274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 266/526] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.324101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.379419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc87e13-b12f-464b-9beb-23bd78f65867 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.419960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.420979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.421705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.422090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.423285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.423848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.426022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.429909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61bbf-7b61-470e-887c-495557b60837 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.445581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 261/527] 10.222.0.57 () {56 vars in 1139 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.447206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.467826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.473685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.474540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.475082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.475425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.476308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.476648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.478598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.484277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 267/528] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.485144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.547179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.584967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924776-06ff-4ca3-b772-83850c733ab9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.627364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e422-c346-4e8d-8966-d17da86dac6b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.632241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.633100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.634695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.635202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.679253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.679926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.680252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.680543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.682600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=9548a1d963a644559c769715d0d58c9e) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:38.682782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.684583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.693809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 268/529] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/role_assignments?user.id=9548a1d963a644559c769715d0d58c9e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:38.694647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.721231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.723828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.797062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.840354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697996f-94bd-410f-aff8-57c146d7f3df None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.887149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.888171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.888689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.889333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.907469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:38.952384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 262/530] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:38.957560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.970629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.972411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.041412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:39.092691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 269/531] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:39.103840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.150148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ca37-89d6-4a62-91b9-9aab0f4ff6ee None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.222744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.223901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.226758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.227782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.251411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.253083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:39.282698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:39.283768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:39.284641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:39.284641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:39.284641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:39.284641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:39.290661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 263/532] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:39.296407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687297a7-24d6-473d-a5e6-157b36843f5c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.298912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.338584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:39.395820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.397518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.397806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.398087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.421755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.423261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.453338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21971-3f1e-48d8-a9fa-906e8d4165d3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:39.461105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:39.461998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:39.462863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:39.462863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:39.462863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:39.462863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:39.462863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 270/533] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:39.470356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.501518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:39.517385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.518353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.518874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.519358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.520312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:39.520851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.522442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.559012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 264/534] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:39.564258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.601168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222011c-1fa1-4f0e-90a3-dd6fa0e81898 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.640164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.640922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.641236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.641652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.642389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:39.642708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.644209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.662521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 271/535] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:39.663944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.693726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:39.715992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62841a-bb76-44b4-bd81-8e6c080cafe3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.747577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:39.780945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf508e-1aa6-4a49-9bb4-a66ce386076a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:39.795118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.795982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.796277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.796557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.812319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.813767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:39.845720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:39.846637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:39.847488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:39.849576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:39.850390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:39.854328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:39.854612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:39.855263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 265/536] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:39.856437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:39.868827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:39.870695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:39.901067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:39.901977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:39.902815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:39.911189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 272/537] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:39.916934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:40.074842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae73b-934a-463f-9cf5-81a4b6ebf6e7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:40.116329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd018-7a40-48a4-8eea-32f09f512012 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:40.138971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:40.139654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.139944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.140227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.141124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:40.141442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:40.142917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:40.176092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 266/538] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:40.182948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:40.195427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:40.200407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:40.205491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:40.207624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.207932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.208223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.217210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:40.217210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:40.217210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:40.241119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 273/539] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:40.246417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:40.400203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d140c8-3b83-4ff1-8102-8fd15f718a5f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:40.434058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68b5b-0fee-4863-a535-43acd47e8994 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:40.478323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:40.479009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.479299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.479582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.480433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c761026c0e3e466d9f485c5dd6b6acbe) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:40.480780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:40.482237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b498f9-a536-48b2-ada6-8adde9a680cd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:40.496952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 274/540] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:40 2022] GET /identity/v3/role_assignments?user.id=c761026c0e3e466d9f485c5dd6b6acbe&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:40.505609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:40.506311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.506608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.506894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.507756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=d6d25014e11e4765b66fc04586547473) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:40.508079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:40.510678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841406-ca21-4ce3-b2d4-19e6f460388a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:40.518121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 267/541] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:40 2022] GET /identity/v3/role_assignments?user.id=d6d25014e11e4765b66fc04586547473&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:40.677741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc8b3-442b-4785-a38a-91e79d6c424a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.677938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc8b3-442b-4785-a38a-91e79d6c424a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.678230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc8b3-442b-4785-a38a-91e79d6c424a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.679629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 275/542] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:40.686449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242dbf7-09be-468d-bef0-498ceed16d45 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.686745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242dbf7-09be-468d-bef0-498ceed16d45 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.687006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242dbf7-09be-468d-bef0-498ceed16d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.709856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-4242dbf7-09be-468d-bef0-498ceed16d45 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:40.711117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4242dbf7-09be-468d-bef0-498ceed16d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:40.799106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 268/543] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:40.824872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc8b3-442b-4785-a38a-91e79d6c424a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:40.894695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:40.955032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc8b3-442b-4785-a38a-91e79d6c424a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:40.985712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f066b-11bf-4d7d-a283-64099a7983e7 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.985712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f066b-11bf-4d7d-a283-64099a7983e7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.986155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f066b-11bf-4d7d-a283-64099a7983e7 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:40.987722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 269/544] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:40.993346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:40.993758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:40.994050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.005402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.012956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.022614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.022614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.022614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.031230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:41.032450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:41.037177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:41.052936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:41.053876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.054673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:41.057436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 276/545] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:41.063085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.161936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 270/546] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:41.184240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.250331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eaac0-5899-43cd-ac94-80de2c827a7f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.288133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.320161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.320935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.321227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.321661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.322424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:41.322734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:41.324115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddc73-7725-4311-9b29-c06d9db0d682 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:41.338820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 277/547] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:41.340334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35447-e992-4664-9caa-2eaa2ef4f79c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.340661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35447-e992-4664-9caa-2eaa2ef4f79c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.340957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35447-e992-4664-9caa-2eaa2ef4f79c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.346212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 278/548] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:41.347107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35447-e992-4664-9caa-2eaa2ef4f79c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.352267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1b4f-014b-4dac-9558-a11c9dc80a06 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.384842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.392247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782da7-801d-445a-9223-d932111c090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.394384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782da7-801d-445a-9223-d932111c090f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.394384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782da7-801d-445a-9223-d932111c090f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.394384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782da7-801d-445a-9223-d932111c090f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.404714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782da7-801d-445a-9223-d932111c090f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-54782da7-801d-445a-9223-d932111c090f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:41.412760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:41.413647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.415497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:41.418126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 271/549] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:41.422779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.422779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.422779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.442572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:41.443790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:41.472322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35447-e992-4664-9caa-2eaa2ef4f79c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.510815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.512033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.512530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.513081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.525123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 272/550] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:41.526061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.527065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:41.528811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:41.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:41.552937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:41.553805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:41.553805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:41.553805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:41.553805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:41.558595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 279/551] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:41.563836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.604412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.661807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66166b-6f93-4a78-a7e8-bb8a0ed05bf7 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.689845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dc219-029a-4fdf-9a9e-ccb21af468d8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.699400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.716915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.717591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.717879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.718155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.718906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:41.719217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:41.720597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:41.738776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.738776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.738776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.738776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.739156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:41.739156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:41.739156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:41.739557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 273/552] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:41.741480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.752434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 280/553] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:41.753254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.867461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:41.878662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe941c-a3a1-4885-b0a8-a7cb6d9ca751 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.882618 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c855a-6675-40e8-9653-15175793a9b1 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:41.921428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.922269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.922559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.922840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.926139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:41.926936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:41.927227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:41.927508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:41.934856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:41.939377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:41.940912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:41.943303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:41.944335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:41.945212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:41.950060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 274/554] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:41.951070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:41.960812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:41.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 281/555] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:41.966031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.004075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.066699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184670-0319-426c-bdb6-c797e4f9f821 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.074907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41d7a-d4c5-451a-82b8-d34858a37cb5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.104077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.105291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.105728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.106246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.111731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.112399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.112718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.113005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.113946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:42.114258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.115392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.115640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.117287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.129889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 282/556] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:42.129889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.130486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:42.139421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:42.147010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 275/557] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:42.148442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.246820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba186-54d5-4a71-a53f-3938730a708c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.269407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d6c1f-340a-4425-9a7b-68f52cf73849 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.272119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.285344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.286235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.288505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.288505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.288505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:42.288505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.290654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.304773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 283/558] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:42.307038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.312662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.312662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.312662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.312662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.322908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.324129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:42.341928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:42.343101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:42.344090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:42.344090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:42.344090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:42.344090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:42.347904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 276/559] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:42.348766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.394812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.448860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b51b17-c7be-4ea2-8901-9728d811e5ee None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.460640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67544b-1eb2-4d97-bf4d-92cbb462af28 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.493259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.494280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.494501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.494792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.495705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:42.496004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.497491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.509908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.511007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.511441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.511888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.520079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 284/560] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:42.521119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.523173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.526190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:42.545809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:42.547018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:42.548262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:42.556354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 277/561] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:42.557909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.585847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.653910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0498d4-bad4-463b-9c83-b614d0915cf6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.680235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.693061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.693889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.701031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.701031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.701031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:42.701031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.701327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474263b-bb77-47dc-8fb9-fb185b156b36 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.701405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.714495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 285/562] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:42.715657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.735832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.736899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.737394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.737859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.814340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.816180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.823860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6d49-8379-4c1e-9242-258573b582ef None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:42.835731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.861940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:42.862442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.862805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.863169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.864323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:42.864753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:42.866319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:42.892950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 286/563] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:42.892950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.939951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:42.944021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 278/564] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:42.945371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.005912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac52-e7c1-482d-b3a1-093f69a2e4da None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.042940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.043794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.044089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.044374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.051976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.053737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.059980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef4d6-0228-41b2-8863-3a1b1ccf79ab None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:43.069162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.070148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:43.071633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 287/565] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.072457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.081807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.100109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.100942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.101229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.101503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.112064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.113553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-bfcbb34b-542a-47ed-b1b4-62098fb5c3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:43.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.133987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.134874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:43.134874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:43.134874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.134874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:43.134874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 279/566] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.135825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e0ae-b49c-470a-936e-4b6296364b0c None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.136116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e0ae-b49c-470a-936e-4b6296364b0c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.136395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e0ae-b49c-470a-936e-4b6296364b0c None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.137840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 280/567] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:43.138373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e0ae-b49c-470a-936e-4b6296364b0c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.181526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.184417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81e4e6-76a4-4e08-ab59-adb9d495db74 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.218000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.218723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.219015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.219295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.235416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.237030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.250034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e0ae-b49c-470a-936e-4b6296364b0c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-b8af6882-0a79-428f-bc9c-b25e739203d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:43.255466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.256521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.257665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:43.257665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:43.257665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.257665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:43.257665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 288/568] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.258770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f037-20f8-461e-ac8c-47cca451d5e6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.259064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f037-20f8-461e-ac8c-47cca451d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.259349 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f037-20f8-461e-ac8c-47cca451d5e6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.261062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 289/569] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:43.261405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f037-20f8-461e-ac8c-47cca451d5e6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.292107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.293016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.293487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.293771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.294609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:43.294921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.296351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b5f9a-5c51-4526-875a-d41fee45678e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.314162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 281/570] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:43.316010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.316298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.316576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.333627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:43.334846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:43.356691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.367792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f037-20f8-461e-ac8c-47cca451d5e6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.401626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.411704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 282/571] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:43.411826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.411826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.411826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.412157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.412248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:43.412248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.412248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351676f1-79e5-45d1-82cf-04e1ebaf69fe None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.428124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 290/572] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:43.429436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.429763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.430004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.446111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:43.447321 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:43.454631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.501496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743859-9dda-4981-a25c-1d64a53f5892 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.513389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 291/573] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:43.514891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.539096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.541044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.541044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.541248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.541934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:43.542237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.543588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.554852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 283/574] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:43.555580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.573294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.618786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ddf79-81b7-41ed-aafa-6c76a3cfc225 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.652568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.653443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.653653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593804-fbd0-4b9a-8acc-8e62c1ba7d4d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.653786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.654064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.665029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.666878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.668557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:43.684555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.685723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 292/575] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.686803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.689789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.690585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.690974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.691147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.701345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:43.709053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.709983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:43.710818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 284/576] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.711645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.788793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c2b4-5e27-431f-a063-5b6957612cde None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.791696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.813544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b5ae-42a8-448c-9ebe-f8b77b288efe None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.822769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.823565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.823854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.824142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.830750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.832193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:43.846286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.847350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 293/577] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.848463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.850572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.851613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.852632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.852752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.863095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:43.871573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:43.872499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:43.873377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 285/578] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:43.874090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:43.907465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.953306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6061-9860-4c75-9c4a-871c43dfb3c5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.973053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e4cb-05e6-4d51-a540-4ff35262108a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.987708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.988509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.988827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.989113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.000891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.002695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.009355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.010020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.010312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.010592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.011326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.011639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.013143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.016012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:44.017895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:44.019053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:44.019994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 294/579] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:44.020485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.031406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 286/580] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.031406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.125062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781b3f-24d8-4746-8353-959b7c09b917 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.127323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d0b5-19d6-42eb-ac32-3e9d37590511 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.139818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.159646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.160312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.160602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.160928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.161365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.161674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.161984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.162092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.162308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.162589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.163364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.163469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.163678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.165316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.176129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 295/581] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.182652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 287/582] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.182799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.182914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.241234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.280861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a640-e96a-413b-b672-271b5d3363a4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.284699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ebce5-fbb9-43ab-9e04-3b7f76bc5f5a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.314027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.314701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.314987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.315264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.316017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.316331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.317743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.318254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.318913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.319201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.319480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.320259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.321201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.322620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.326559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 296/583] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.327353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.335210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 288/584] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.335497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.373677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.432752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c6c2-d37e-4f55-9003-a3d2948d0fc8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.439235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb64f3-9af8-402f-91c9-73c5b5b5a33d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.456397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.467005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.467569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.467862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.468141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.474442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.474634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.475230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.475517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.475795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.476077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.486794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.488298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:44.490007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:44.490979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:44.491912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 297/585] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:44.492444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:44.506822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:44.507741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:44.509346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:44.509346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:44.509346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:44.509346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:44.509346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 289/586] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:44.510315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.596743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.600144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814fd35-46e9-42f9-915f-f5ffa86bdc90 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.614013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73413f-2aff-4a0f-8ca9-79e50b9e5441 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.635368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.636263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.636547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.636856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.647617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.648537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.648948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.649226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.650626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=c0b8fde7b5024cf5b39899fae30a463e, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.652073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.659316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.660782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:44.678788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:44.680482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 290/587] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:44.681510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.701818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.762359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 298/588] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:44 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:44.763474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.778225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129dac0-81a2-4244-9560-42bba58ddd70 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.818732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.819413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.819708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.820029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.820974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=24ea77596372484aaefd59eaad6403ee) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.821294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.822944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.829884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 291/589] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/role_assignments?user.id=24ea77596372484aaefd59eaad6403ee&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.830596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:44.931441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e88f-6d03-458d-8639-1051c868d12a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.958303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:44.978403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:44.980534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:44.980534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:44.980534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:44.980983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:44.981059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:44.982501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:44.983224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638cf7-9993-4077-a61e-4b90e0918596 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:44.997387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 299/590] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:44.998062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.016793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.041698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.042806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.043347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.043864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.044835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:45.045359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.047030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.061935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 292/591] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:45.063161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.138288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d34c-aeb9-4061-acf7-ebf2d5e76c09 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.177299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703d65-c1c8-4913-b752-577d987db34c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.191281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.192204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.192515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.193257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.194247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:45.194562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.197295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.214049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 300/592] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:45.217570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.228633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.228633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.228633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.228633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/9548a1d963a644559c769715d0d58c9e/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.239318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=9548a1d963a644559c769715d0d58c9e, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.241043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.244344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.300552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.311524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 293/593] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:45 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/9548a1d963a644559c769715d0d58c9e/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:45.312358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.374043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7815-f18a-42b8-9556-6a33927a8797 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.437446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.438452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.438638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.438925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.461924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6fc4-c508-4e98-bdb3-a260c57549a4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.463082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.464655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:45.497532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:45.498597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:45.499562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 301/594] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:45.510406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.511501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.511950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.512382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.516137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.521882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.525211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:45.542357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:45.543598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:45.544774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:45.546950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 294/595] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:45.552538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.615216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.666205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b30cf-0f2b-4c8d-a8ca-3263a6898b2e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.669716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d85a-fb75-4ab9-b8e1-f2a18462d365 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.705161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.706374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.706815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.706991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.707407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.707674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.707973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.708259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.708924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:45.709144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:45.709524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.709674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.711051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.711965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.732272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 295/597] 10.222.0.57 () {56 vars in 1139 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:45.732442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 302/597] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:45.732633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.737865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.738335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.844817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e78be-0967-47d5-ac0d-6585bc2a8237 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.869324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:45.877198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c8b5-9d80-4f19-a5e3-259a045d4247 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.894697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.895521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.895794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.896077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.906610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.908075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:45.927509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:45.928424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:45.929705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:45.929705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:45.929705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:45.929705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:45.929705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 296/598] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:45.940630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.993704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.994437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.994724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.994998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.013640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.015639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.052244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db947d3-cbc7-4337-9547-1592fdfb82c0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:46.052645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:46.053722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:46.054841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:46.054841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:46.054841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:46.054841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:46.054841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 303/599] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:46.065709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.090497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.091177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.091468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.091750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.092483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:46.092834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.094216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.107396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 297/600] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:46.113005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.154815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:46.201052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:46.281684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b074f8-9b39-435b-969d-f8d5a574683d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.333483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1cc11-1015-48e7-ae93-617cbd04a56c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.373007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.377958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.378270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.379380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.397347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.399410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:46.423338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:46.424317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:46.425246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:46.425687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 298/601] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:46.432399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.445333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.446339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.446565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.446841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.447576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:46.447883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.449304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.480058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 304/602] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:46.485791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.543626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:46.566192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76661-2d47-4274-828d-9156735d9d94 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.609221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.610284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.610681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.611060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.612361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:46.613034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.614583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.635612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 299/603] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:46.643539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.682801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:46.694863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695f5c-9b55-4208-8e3b-0efcac591645 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.771442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.772260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.772551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.772872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.783623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.785168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:46.799978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:46.801041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:46.801947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:46.814357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071fa31-22d5-4603-a313-6409067b3d79 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.817648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 305/604] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:46.824439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:46.878917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.880432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.880903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.881194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c761026c0e3e466d9f485c5dd6b6acbe/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.910843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=c761026c0e3e466d9f485c5dd6b6acbe, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.912512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa46a-2762-4856-8b0c-9293c95a75ae None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:46.916963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:46.949063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e6710-e6f9-4def-97ca-76df65102ec8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:46.988659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:46.989374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:46.989665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:46.989983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:46.990745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:46.991060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:46.992602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:47.006482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 306/605] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:47.014366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:47.037395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 300/606] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:46 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c761026c0e3e466d9f485c5dd6b6acbe/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:47.041288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:47.191636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8866b6-e854-4287-af99-21c388714f02 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:47.245774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:47.246714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.247000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.247281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/d6d25014e11e4765b66fc04586547473/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.279988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=d6d25014e11e4765b66fc04586547473, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:47.282814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43adf01-0850-444c-9219-9b0b9c777818 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:47.355874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 307/607] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:47 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/d6d25014e11e4765b66fc04586547473/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:39:47.547523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af1e3-2542-4892-abd4-047a91c574a0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.548192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af1e3-2542-4892-abd4-047a91c574a0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.548748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af1e3-2542-4892-abd4-047a91c574a0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.551193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 301/608] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:47.557716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.558004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.558290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.583171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:47.584455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:47.674231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:47.679969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 308/609] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:47.702123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8b2-1e13-4dc3-9e68-8fcff240189d None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.702641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8b2-1e13-4dc3-9e68-8fcff240189d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.702747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8b2-1e13-4dc3-9e68-8fcff240189d None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.704441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 302/610] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:47.711133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:47.714641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.714932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.715212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.745650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:47.747984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:47.849652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724d23-848f-4293-84e4-dd75d58a34ba None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:47.852931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 303/611] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:47.887853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:47.888733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:47.889020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:47.889296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:47.890734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:47.923139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:47.932726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:47.933765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:47.934614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 309/612] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:47.940374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.056984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.081917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3cc7-4f31-4306-89db-40eaed57f0fb None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.107118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.118932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.121079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.121079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.121079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.140594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:48.147171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fc3d-f0b9-493a-8bf0-ac532d10ac36 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-d5f4c421-1c03-4e19-a6ce-5c0d5f3cfada None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:48.153298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:48.154352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:48.155351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 304/613] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:48.156432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb7f-4103-43b4-8926-3ff3b6015f22 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.156566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb7f-4103-43b4-8926-3ff3b6015f22 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.157033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb7f-4103-43b4-8926-3ff3b6015f22 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.163057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 305/614] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:48.164028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afb7f-4103-43b4-8926-3ff3b6015f22 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.197322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.198276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.198564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.199003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.200084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:48.200404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.202223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181fc4-e304-4738-87f7-1ac61eb119e3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.213767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 310/615] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:48.215146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.215444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.215728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.236547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:48.238296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:48.287234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afb7f-4103-43b4-8926-3ff3b6015f22 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.322883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 311/616] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:48.323777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.334275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.335021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.335312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.335588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.337138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:48.337452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.338942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.354088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 306/617] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:48.359301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.379077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.414191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.436355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac43b21-7350-4ed8-9774-769589254a58 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.472095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033d1a-0338-4071-9f6a-8bd3f6cdda60 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.477006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.477809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.478260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.478554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.489928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.491610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.509750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.510656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.511014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.511363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:48.511561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:48.513486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 312/618] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:48.515606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.523248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.525332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:48.543473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:48.545537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 307/619] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:48.547720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.626178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2449fe-2569-4ff6-a08f-5b4144bb8abf None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.627781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.645468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.649557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178228-a566-44fb-9fbe-8f8509fa8a55 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.664885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.665956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.666246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.666530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.678099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:48.684937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.690342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.690342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.690342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:48.690578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:48.691456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:48.692291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:48.692986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:48.692986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.693115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 313/620] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:48.693184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.693252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.706498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 308/621] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:48.707151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.812642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8d9bf-8d91-4500-b12f-5a11ba345f55 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.822680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26fd58-c149-4832-9ccf-2344b5887736 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:48.857767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.858498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.859073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.859363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.860099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:48.860415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.862808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.870937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:48.871897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:48.873382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:48.873382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:48.874475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:48.875561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:48.877544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:48.878203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 314/622] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:48.879135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.893179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 309/623] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:48.894420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:48.912489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.923925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:48.997050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fadea-3170-47d3-a4f6-fdeb4a52ebfa None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.007670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cfe7-bc66-4b12-953d-e9d0cff4bb56 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.035028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.036264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.036807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.037293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.044351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.045189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.045527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.045746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.046920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.048861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.054035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.055620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:49.065059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.066052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:49.067048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:49.069944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 315/624] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:49.070067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.071710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:49.072674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 310/625] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:39:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.073275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.075834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.159290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.168521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.179754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cc7e-e105-4d60-aede-cbb5c320668d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.187660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c1441-3638-4c5e-85d4-780489590a54 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.214425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.215471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.215929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.216394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.223656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.224417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.224808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.225146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.226053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:49.226445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.228878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.231027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.232698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.248534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 316/626] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:49.249596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:49.253270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.254147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.255099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:49.255099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:49.255099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:49.255099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:49.262395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 311/627] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.263633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.366383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57731e8c-2aae-47f2-b6a8-3ccf9ffa5396 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.375524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4ec4-b0ab-4921-8b42-1526c390f0b7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.408146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.409030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.409960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.410395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.410825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.411864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:49.412502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.414287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.414712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.415921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.416302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.416699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.426145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.431589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.433476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.437254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 317/628] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:49.438236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:49.453799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.454857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.455989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:49.455989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:49.455989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:49.455989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:49.458089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 312/629] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.459669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.557319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fc27-f564-4c15-bdeb-6a93709e5e62 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.566943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b7a1-631d-4f0a-95e4-6bcfb3731a5a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.595027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.595744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.595988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.596334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.597047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:49.597362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.599041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.604085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.605056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.605572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.606056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.615534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 318/630] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:49.615534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.667230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.677899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.683706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.685228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfe69c-21f2-40d3-9f63-33600b17d28a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.720056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbaed5-ed8d-4a23-b9b4-d53ceefaa1ad None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.761906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.762612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.762903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.763186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.764503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:49.764848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.767086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.783355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 319/631] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:49.784591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.796023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 313/632] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:49.797392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f35a1c-0ac8-4b07-832e-61ab3e19c073 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.797802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f35a1c-0ac8-4b07-832e-61ab3e19c073 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.798148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f35a1c-0ac8-4b07-832e-61ab3e19c073 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.803784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 314/633] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:49.803784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f35a1c-0ac8-4b07-832e-61ab3e19c073 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.892395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.902052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dcc8-6968-4e80-8e00-3e2ec2b55fe1 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.911093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f35a1c-0ac8-4b07-832e-61ab3e19c073 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.921046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:49.939197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.940242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.940534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.940843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.948139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.949710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.954601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.955409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.955700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.956147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.963455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.964923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:49.965034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.966091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 320/634] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.967257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-a63e67a1-2b1b-4d10-a16f-026349e19526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:49.982495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:49.983441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:49.984323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 315/635] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:49.984923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1d2e-5e14-4305-b3de-17db7d575e55 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.985241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1d2e-5e14-4305-b3de-17db7d575e55 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.985554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1d2e-5e14-4305-b3de-17db7d575e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.001928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9bdd1d2e-5e14-4305-b3de-17db7d575e55 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:50.003116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bdd1d2e-5e14-4305-b3de-17db7d575e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 316/636] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df670d-7f0c-4db6-9ffb-4c9d4edb5381 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df670d-7f0c-4db6-9ffb-4c9d4edb5381 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df670d-7f0c-4db6-9ffb-4c9d4edb5381 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 317/637] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:50.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df670d-7f0c-4db6-9ffb-4c9d4edb5381 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.083519 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b59d1-5959-47d0-a8bf-98e3eb823893 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.119097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.119884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.120169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.120448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.130130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.131562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.147676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:50.149565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:50.150521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:50.151412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:50.151412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:50.151412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:50.151412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:50.151412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 321/638] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:50.151693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.178183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df670d-7f0c-4db6-9ffb-4c9d4edb5381 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.183766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.214892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.215658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.216015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.216300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.217168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:50.217484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.218936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818ae4-77c5-44cb-9236-eefc7bca2840 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.237255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 318/639] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:50.238503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.238797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.239082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.254949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:50.256125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:50.258541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f246c-b431-43d4-9c26-a603bb9676b6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.293987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.294647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.294939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.295223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.296017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:50.296329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.297819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.309288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 322/640] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:50.310242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.328127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 319/641] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:50.328998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.388886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.413272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.422769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb830fa-9c08-4a69-a1a5-de144800cf6e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.425999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a0ef-04fc-4a1f-b18d-8e532e44d627 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.455792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.456518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.456838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.457121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.465150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.465815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.466100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.466380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.467114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:50.467421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.467575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:50.468811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:50.475546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:50.477352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:50.478404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:50.480620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 323/642] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:50.481368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.490637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 320/643] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:50.490637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.587906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4bea-2287-4196-972b-4bc914bdad04 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.588569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccc51a-bc5e-460e-ba90-ce21deb37baf None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.611904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.620729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.621365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.621653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.621933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.623596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.624487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.624817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.625722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/24ea77596372484aaefd59eaad6403ee/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.639940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=24ea77596372484aaefd59eaad6403ee, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.640793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.641438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.689112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.690560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.714513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 321/644] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:39:50 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/24ea77596372484aaefd59eaad6403ee/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:39:50.714513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.804290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 324/645] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:50.805794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.846832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412db2-d93a-455b-8176-726bbb9e28eb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.869571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.888510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.889366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.889656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.889942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.902964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:50.910850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:50.911780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:50.912782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 322/646] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:50.913550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:50.937353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9f8fe-9ab8-4e0a-b0a3-5eb08b2165a3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:50.949421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:50.973760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:50.974361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:50.974653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:50.974933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:50.975687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:50.975998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:50.978054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:50.990445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 325/647] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:50.990445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.028819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa8c0-5a7c-4ec9-b7b7-17c02496d71c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.065947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.066778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.067070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.067352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.076478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.078027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:51.093100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:51.094162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:51.095266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:51.096421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 323/648] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:51.096527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396255-b7a3-43a4-9304-480762cef35e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.102256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.111047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.133991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.134801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.135092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.135372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.146074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.147532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:51.165453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:51.166770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:51.167842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:51.167842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:51.167842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.167842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:51.171434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 326/649] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:51.172262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.204929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.214846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a843-c9c2-459a-8516-32faf71284a7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.255829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.256681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.257062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.257434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.258619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.259011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.260467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.269266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 324/650] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:51.274596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.287019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf266e9-6b16-4854-8c66-b1553ce172e8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.335614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.336513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.336821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.337096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.347498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.348976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:51.366853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:51.368442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 327/651] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:51.369722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.388718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702f06-d802-4b61-8126-6f067ccd0886 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.389003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.425669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.426328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.426611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.426884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.427674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.427968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.429408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.447941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 325/652] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:51.447941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.463331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.483082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc7a7b-f5dd-4d6f-b867-1063e74a7697 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.520344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.520964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.521253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.521536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.522265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.522576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.524492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.542219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 328/653] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:51.542219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.554005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722de86-8312-4ff2-b782-5d5f5b832bef None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.591330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.592153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.592439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.592750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.604162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.605632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:51.624054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:51.625144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:51.626254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:51.626254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:51.626254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:51.626254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:51.629812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 326/654] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:51.630653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.630970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.658000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c511-c1f3-4f8b-861c-7a1793084f38 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.696874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.703930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.704601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.704919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.705206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.705934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.706652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.708385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.728870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 329/655] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:51.728870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.732135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c5688-6cec-4732-bf17-852b9ef3b2ff None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.767961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.768651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.769100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.769386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.770251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.770625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.772125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.788643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 327/656] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:51.788643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.854044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300020de-cc89-449c-b276-4cf77b589d4a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.896976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.897997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.898984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.899473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.903348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.908560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.910363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:51.926354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:51.927388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:51.928295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:51.928757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb8a8-e427-4f37-8690-4d221fd2c71b None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:51.929155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 330/657] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:51.929155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:51.970149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:51.977707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:51.980391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.980391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.980391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.980679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:51.980917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:51.982991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.000710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 328/658] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:52.001965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.055978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf514-016e-44b1-9a77-48b1ec2ffd67 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.098787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.099597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.099886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.100167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.111210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.112848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.129286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8e36-d0fe-437d-95f3-5a2fa7d5effe None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:52.130751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:52.131903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 331/659] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:52.133170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.176717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.177760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.178255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.179282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.181084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:52.182103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.184440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.198757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.202318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 329/660] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:52.203477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.256036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16863-9557-4f78-95bf-76b2a04650a0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.269297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.295104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.296419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.297328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.297328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.311072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.313367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.331327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff64ec-18b8-46eb-b4e5-8cf1ba563555 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:52.331765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:52.332782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:39:52.333802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:52.341590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 332/661] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:52.341867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.373571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.374623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.375121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.375605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.376671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:52.377182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.378796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.398141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 330/662] 10.222.0.57 () {56 vars in 1139 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:52.399981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.454545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adb99-d8ca-4075-a0f8-0d0b119e2b08 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.472990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.494466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.495588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.496073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.496561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.497613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=9548a1d963a644559c769715d0d58c9e) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:52.498240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.499956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.512834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00bd8f-eb0b-4d2a-aeaa-c1d99bf0a375 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.513306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 333/663] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/role_assignments?user.id=9548a1d963a644559c769715d0d58c9e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:52.514494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.520971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.578639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.585525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.586345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.586663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.587737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:52.587934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.589548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.640497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 331/664] 10.222.0.57 () {56 vars in 1137 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:52.648637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.651246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8ac8-9603-4f50-ba47-add0e12ddd36 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.691488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.692528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.693113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.693588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.754990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.774301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.776021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.832538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af50-07f8-41ea-bb05-5c905076d3b2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.879349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.880107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.880397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.880726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.916403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:52.918228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 334/665] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:52.923249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.957298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.958873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.038965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.064218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3164e1-2711-440a-b222-8383958b64ec None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.086926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 332/666] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:53.100784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.116233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.118043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.118333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.119195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.134900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.136723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:53.166728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:53.167713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:53.169165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:53.169165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:53.169165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:53.169165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:53.169165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 335/667] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:53.173401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.189100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.243679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf74a-4f75-43bf-9b9f-77911ea220f4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.291451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.292695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.293087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.293897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.303582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354f848-751b-4958-8bf2-0c1c6cf70025 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.309147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.312787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f501d47b-adbc-4f77-82b4-3062b27cde94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:53.340249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:53.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:53.342210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:53.342210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:53.342210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:53.342210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:53.343441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.344322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 333/668] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:53.345881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59839-189c-4347-9a93-a83401d64e89 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.346355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59839-189c-4347-9a93-a83401d64e89 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.346812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59839-189c-4347-9a93-a83401d64e89 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.348278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 334/669] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:53.353886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59839-189c-4347-9a93-a83401d64e89 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.355214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.355891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.356178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.356457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.357228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:53.357540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.359252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3604-f9a8-4fa3-9047-a0f510787dad None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.377018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 336/670] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:53.380862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.381384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.381869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.408514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:53.409764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:53.483558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59839-189c-4347-9a93-a83401d64e89 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.492319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 337/671] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:53.493569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.502275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.520743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.532797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.538183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 335/672] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:53.543946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.650599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2e61a-4ee2-4f09-ac57-8e78ac3d58b2 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.669099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11448-5e0f-4fcf-a19e-9d626db12b34 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.679357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.694127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14536808-421d-415f-9e3f-03e174235afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.694933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14536808-421d-415f-9e3f-03e174235afe None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.695938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14536808-421d-415f-9e3f-03e174235afe None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.696586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14536808-421d-415f-9e3f-03e174235afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.706030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14536808-421d-415f-9e3f-03e174235afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.707552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14536808-421d-415f-9e3f-03e174235afe None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.709046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.710137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.710623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.711793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.719223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.721068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-14536808-421d-415f-9e3f-03e174235afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:53.722884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:53.723777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:53.724686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 338/673] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:53.725213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14536808-421d-415f-9e3f-03e174235afe None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:53.741351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:53.742613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:53.743517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:53.746328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 336/674] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:53.747376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.805330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:53.863461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14536808-421d-415f-9e3f-03e174235afe None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.871986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104eba6-6fc2-4c1f-a6a9-8563c247aca4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:53.908953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.909643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.909932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.910212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.911005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:53.911320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:53.911642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:53.912695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:53.912801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:53.913264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:53.913745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:53.925523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 337/675] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:53.926407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:53.927925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:53.939607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:53.940562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:53.941461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:53.942689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 339/676] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:53.945978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.005649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.040743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.045568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53fd6c-b577-4e5d-b30e-7866af135385 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.081710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ddc3-e701-4ccb-ac59-f39a97245b8a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.098607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.099784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.100249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.100704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.102549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.103377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.104983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.121348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c761026c0e3e466d9f485c5dd6b6acbe) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.126594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.127304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 338/677] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:54.128597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.134260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 340/678] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:53 2022] GET /identity/v3/role_assignments?user.id=c761026c0e3e466d9f485c5dd6b6acbe&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:54.134688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.268648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb742c73-e259-4fb8-9bf3-1443f2afbd6b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.275071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda39e14-be2a-4eed-a1a5-11954f71ef2e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.277610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.310540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.311362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.311655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.311938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.312930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=d6d25014e11e4765b66fc04586547473) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.313250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.314718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e205-ac90-488b-a8b8-43215c58a20b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.318838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.319740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.320282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.320732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.321639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.322093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.322350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 341/679] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/role_assignments?user.id=d6d25014e11e4765b66fc04586547473&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:54.328697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e3e-d5f3-46d6-8454-96d9d66adca0 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.328697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e3e-d5f3-46d6-8454-96d9d66adca0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.328697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e3e-d5f3-46d6-8454-96d9d66adca0 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.329942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 342/680] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:54.330878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.331844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.332140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.332486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.348950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 339/681] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:54.352155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:54.353444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:54.355818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.397662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.448790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 343/682] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:54.468320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.488209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd494-5237-4b62-adf7-91f6f9a8eea0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.530347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.531762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.532197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.532702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.546706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.548694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:54.569692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:54.571304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:54.572282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:54.572282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:54.572282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:54.572282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:54.574672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 340/683] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:54.580166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.589848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.592685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea8c5b-5bb2-4b97-96a0-80ecfd44a630 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.642791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.643894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.644362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.644897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.659967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:54.669228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:54.670202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:39:54.671035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:54.671673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 344/684] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:54.676087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.679327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.707531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af424b99-9b27-4993-b662-972dea1549f0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.756449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.758100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.758691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.759211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.760085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.760539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.762306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.779371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 341/685] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:39:54.787138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.821110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4de85-497c-4116-b3a3-16b918d1dab4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.885196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.886247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.886755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.887244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.888190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:54.888719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.890480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.915855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a89d77-0400-4be9-8669-42768af20b41 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:54.926860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 345/686] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:54.932921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:54.947861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.952867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:54.953695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:54.953986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:54.954269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:54.962433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:54.963916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:54.980835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:54.981877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:54.983035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 342/687] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:54.988425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:54.989174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.097153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7fef0-b03a-4ff9-9374-c4b2762c61d0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.133379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.134428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.134791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.135144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.136070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:55.136455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.138126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.158126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 343/688] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:55.165908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.178546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0db6-a448-42ef-8b26-52c378f7fb27 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.253264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.254076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.254568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.254966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.274184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.274726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:55.275693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:55.311374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:55.312368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:55.313289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:55.313289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:55.313289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:55.313289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:55.314409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 346/689] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:55.323453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.379713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f5f7-df4f-46af-b1d2-933b86f3b615 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.437380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.438040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.438321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.438599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.464975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:55.513966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537db5-8beb-47af-9a76-db7adc4da701 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.559837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.561323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43eece-9e25-469f-bc5d-c8dfce2e0935 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.562455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.563355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.563655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.563938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.565469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:55.565787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.567154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694c5c-15b9-498b-92ec-8b0b29ff195c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.584011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 347/690] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:55.585575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a8f4-0ccd-49b2-82ea-8b59bb8dcc9f None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.586541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a8f4-0ccd-49b2-82ea-8b59bb8dcc9f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.587155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a8f4-0ccd-49b2-82ea-8b59bb8dcc9f None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.592111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 348/691] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:55.592111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4a8f4-0ccd-49b2-82ea-8b59bb8dcc9f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.626730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:55.695492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 344/692] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:55.697259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.697854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.698460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.705398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4a8f4-0ccd-49b2-82ea-8b59bb8dcc9f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.716565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:55.718211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:55.743797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.744597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.744927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.745209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.747426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:55.754139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.755713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:39:55.772166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:55.773769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:39:55.774943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:55.778837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 349/693] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:39:55.779880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.799318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 345/694] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:55.806534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.899469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69092b-b709-454c-aefa-57efa8603438 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.925057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:55.935528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.950182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.950182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.950182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.950429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6c8b4-db6c-4477-9df8-fa0a7a1060b6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:55.950520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.950880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:55.968420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:55.969384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:55.970284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:55.970284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:55.970284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:55.970284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:55.972713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 350/695] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:55.973791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:55.987429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:55.988384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:55.988852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:55.989342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:55.990468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:55.990929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:55.993611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.013829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 346/696] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:56.015000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.028728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.092492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286df94-69cc-486b-87f2-6b7364012fad None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.131010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.132243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.132904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.133335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.145966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ece44f-52c9-4e7c-ad5e-6ee701170626 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.146603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.148833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:56.169065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:56.170207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:56.171333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:56.171333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:56.171333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:56.171333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:56.177318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 351/697] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:56.177318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.202839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.204133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.205077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.205840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.207295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:56.208235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.210475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.221301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.232836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 347/698] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:56.234231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.298525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.305380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d177d8-a1cb-4e40-82ea-113cde54ab0c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.354593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.355804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.356246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.356955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.366725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919fbc-e95f-4357-ad77-d1252b5cfb37 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.412579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.414004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.414487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.415100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.416404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:56.417153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.419305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.430746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.432348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.440653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 348/699] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:56.442225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.514132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.557187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.564679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 352/700] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:39:56.565809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.576191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a35a5-d34a-4e34-900e-cb2bb39409ec None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.631856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.633253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.634254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.634879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.644911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.647171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:56.667199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:56.668184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:56.669112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:56.670591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 349/701] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:56.671538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.701809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0bd0d-5d75-4ad6-8a3e-7e5ed316b291 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.748421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.749275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.749705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.750078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.750905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.752443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.780851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e669d-6c76-4d88-98f9-f3cc06991c61 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:56.798831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.815664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:56.816461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.816781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.817065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.829800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:56.831296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:56.837892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 353/702] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:39:56 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:39:56.838650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-2d53ea19-d57f-4113-bdd1-1543106c4a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:39:56.864172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:56.872888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 350/703] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2c8a-d6a2-4545-aa2d-1c2d37201ac9 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2c8a-d6a2-4545-aa2d-1c2d37201ac9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.873802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2c8a-d6a2-4545-aa2d-1c2d37201ac9 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.875769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 351/704] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:56.877086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:56.877422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:56.877702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:56.904800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:56.908872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:56.923233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:56.982531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0e5-118b-4c82-b4c5-8f089a8cbe32 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.008754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 352/705] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:57.010128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.033562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.034161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.034449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.034732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.035525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.035843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.037391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d40d9-833f-49b5-879b-faf7d716e4f2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.051793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 354/706] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.053024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45782a-2254-46d6-bbd8-a88ed676748c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.053320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45782a-2254-46d6-bbd8-a88ed676748c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.053602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45782a-2254-46d6-bbd8-a88ed676748c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.055239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 355/707] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:57.055814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45782a-2254-46d6-bbd8-a88ed676748c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.138151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.140935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f923f2-c162-4044-b64d-2708b8aebf53 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.171165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45782a-2254-46d6-bbd8-a88ed676748c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.177080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.177753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.178037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.178317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.179044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.180073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.181490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52d9d-d074-48ec-9e2c-3325595e12a8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.186965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.194131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 353/708] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.195394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.195693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.195974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.211368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.212064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:57.212757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.213243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.213366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:57.213852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] PATH_INFO: `/v3/services/network` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.214724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.216500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:57.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:57.233406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:39:57.234468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:39:57.240959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 356/709] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:57.243131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.287500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 354/710] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:39:57.289232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.358601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad019fa-d4c6-4a3a-9436-28a89770845c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.388963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.394781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.395543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.395817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.396100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.398958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=24ea77596372484aaefd59eaad6403ee) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.398958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.399499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.399814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dedde0-4d75-493c-87b8-4bdcaa87791b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.406126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 357/711] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/role_assignments?user.id=24ea77596372484aaefd59eaad6403ee&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.406927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.448127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.449087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.449428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.449710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.461213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.467145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.471045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:39:57.488161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:57.491395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:39:57.493009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:57.495344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 355/712] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:57.496941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.563163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ea00-dbff-420f-966e-50c680e4c236 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.618258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.619201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.620400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.620400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.621306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.621616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.622993 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.626027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77acd-adba-4145-a276-c227458949cb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.629323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 358/713] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.629627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.673174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.674254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.674543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.675642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.676310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.677840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:57.695777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:57.697023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:57.698136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 356/714] 10.222.0.57 () {56 vars in 1129 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:57.699086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.729143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.748346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da154-f9fa-478e-b6c2-3698479da3f0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.756220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:57.789864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.790986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.791375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.791785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.792764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.793287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.794965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.808151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 359/715] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.809675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.834904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6df9d5-1010-4134-90f0-4d9a7bd3c920 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:57.885428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:57.886362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:57.886652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:57.886933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:57.888378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] RBAC: Adding query filter params (type=network) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:57.888724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:57.890157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:57.899524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 357/716] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:57.900533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:57.983440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71164-2452-4dc0-9c36-add041fb3676 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:58.029763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:58.030462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:58.030752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:58.034437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:58.035209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:58.035532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:58.037009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:58.051296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 360/717] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:58.057619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:58.105530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:58.131443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd55cd-b254-4b2e-8e94-a91064d321be None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:58.142101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:58.180502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:58.181211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:58.181499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:58.181780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:58.182620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:58.182938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:58.184411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9885b7-d241-4eaf-897e-fc5c82b6f84a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:58.191628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 358/718] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:39:57 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:58.272973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cb48-66db-4f8b-b71d-13e8b3dc4d21 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:58.342212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:58.342898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:58.343184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:58.343464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:58.344174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:58.344484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:58.345949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a5893-e4b3-4971-80c2-fc00ecea1b08 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:58.358085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 361/719] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:39:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:59.354872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14ec1-c898-4979-8ed5-745391799755 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:59.355370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14ec1-c898-4979-8ed5-745391799755 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:59.355448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14ec1-c898-4979-8ed5-745391799755 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:59.357056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 359/720] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:59.362304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:59.362721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:59.362890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:59.506242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:59.508027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:59.584142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 362/721] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:39:59.619909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14ec1-c898-4979-8ed5-745391799755 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:59.742843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14ec1-c898-4979-8ed5-745391799755 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:59.791111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:59.791837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:59.792165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:59.792439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:59.806803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:39:59.818351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:39:59.819354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:39:59.821728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 360/722] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:39:59.829793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:59.864211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:59.940799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573360e-de61-4461-81ce-dabb34b8e6ca None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:59.975229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:59.975889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:59.976876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:59.977331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:59.978082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:39:59.978390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:59.979756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087653-a4b0-4072-a18d-4e4e3197a160 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:59.988093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 363/723] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:59.993567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:59.999842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:00.195935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd17d5-f8be-4a19-a3c2-4d7ba8eb44c0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:00.250677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:00.251489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.251773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.252045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.261087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a40c-f23f-45d0-b144-af8c40a62311 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.261370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a40c-f23f-45d0-b144-af8c40a62311 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.261649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a40c-f23f-45d0-b144-af8c40a62311 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.263002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 364/724] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:00.268215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.268836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.269327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.271365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:00.272968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:00.305884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:00.306890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:00.307814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:00.307814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:00.307814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:00.307814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:00.308506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:00.313436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:00.320864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 361/725] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:00.326254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:00.384399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 365/726] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:40:00.411895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:00.419636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:00.450823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:00.466400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496577d6-2a6e-4d5f-9d8a-5211c508d43a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:00.510362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:00.511686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.513064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.513363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.514152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:00.514476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:00.515910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:00.531143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 362/727] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:00.537710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:00.649437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0480a-7af6-4cdd-84bc-6cf5371508a4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:00.654677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768884-bcb3-4b65-aecb-42574f4ed5d1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:00.683970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:00.717680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:00.718415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.718593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:00.718705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.718963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.719371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.719656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.719934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.727312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:00.728968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:00.731246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-f4433726-472f-4761-9412-de3e939e01ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:00.738912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:00.739850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:00.741148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 366/728] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:00.742708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e067c-139a-4d30-9970-951b2a623c0a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.742708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e067c-139a-4d30-9970-951b2a623c0a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.742708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e067c-139a-4d30-9970-951b2a623c0a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.743840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 367/729] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:00.747071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e067c-139a-4d30-9970-951b2a623c0a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-e39adbe0-acf2-4c63-9d1c-c466971e3d38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:00.750665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:00.752114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:00.753423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 363/730] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:00.754189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.754189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.754189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.776282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:00.777921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:00.853149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:00.872639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 364/731] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:40:00.872639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:00.890718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e067c-139a-4d30-9970-951b2a623c0a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:00.955937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:00.956770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:00.957126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:00.957606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:00.959227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:00.959227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:00.960387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:00.974192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 368/732] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:00.974192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.042326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb53b-ef5c-41f4-b3b4-f1fb630e1d41 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.045880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.085077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.085800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.086081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.086358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.086693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20d758-0535-47cd-97d4-9a0077d673cf None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.087290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:01.087602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.089084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.107682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 365/733] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:01.108506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.127828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.128794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.129265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.129721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.130811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.132506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b038dd3-5008-4ce1-879e-5f6df1e25e1f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.213729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d424-10fb-48b6-9561-1d0efabadc48 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.243856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.250684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 369/734] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:00 2022] POST /identity/v3/services => generated 240 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:01.256218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2bdbd-9c30-4aaa-ae2e-4479a9a438f4 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.256218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2bdbd-9c30-4aaa-ae2e-4479a9a438f4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.256218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2bdbd-9c30-4aaa-ae2e-4479a9a438f4 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.256218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 370/735] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:01.256218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2bdbd-9c30-4aaa-ae2e-4479a9a438f4 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.288586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.290747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.291046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.291334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.308863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.310400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-43a47043-3855-47be-b111-adf4e74cbcc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:01.339328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:01.340320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:01.341351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:01.341351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:01.341351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:01.341351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:01.345903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 366/736] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:01.347664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.347974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.348262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.374244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:01.375802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:01.379824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.396283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2bdbd-9c30-4aaa-ae2e-4479a9a438f4 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.442366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.443422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.443959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.444450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.477709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 367/737] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:01 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:40:01.478630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.519339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.523557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.525094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debecee1-b55a-413e-8cce-20dfbd062582 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.589214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f15d-e57a-473b-bd1b-a95da5f847e0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.625712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.626516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.626919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.627200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.627928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:01.628240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.629637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.630480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 371/738] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:40:01.636327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400a3a-825b-438c-b9e6-75331abcc22d None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.636635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400a3a-825b-438c-b9e6-75331abcc22d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.636929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400a3a-825b-438c-b9e6-75331abcc22d None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.638249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 372/739] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:01.638994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400a3a-825b-438c-b9e6-75331abcc22d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.641103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.645587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 368/740] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:01.646712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.748168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.753006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400a3a-825b-438c-b9e6-75331abcc22d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.759630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab780a9-e14a-4bc4-bc2a-5437173e029e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.790490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.791211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.791500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.791783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.795721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.796645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.796969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.797151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.802406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:01.807850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:01.809666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-82db261b-a0a6-42fe-a303-b45811e5353a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:01.811032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:01.811937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:01.813007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 373/741] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:01.813963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.814047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.816623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:01.831747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:01.832223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:01.833380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:01.834435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:01.834435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:01.834435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:01.834435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:01.834672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:01.834748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 369/742] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:01.834748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.893812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:01.909901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 374/743] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:01 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:40:01.910965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:01.955273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632dfe7-dd74-4c31-a6ee-df1058b23f19 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:01.990867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:01.992317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:01.992647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:01.992935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.000785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.002228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.009717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:02.016306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:02.023509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 370/744] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:02.024604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.030755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12930e46-e103-469c-a393-cd536f8b7ae9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.067807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.068405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.068752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.069033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.069914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:02.070229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.071758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.084651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 375/745] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:02.084651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.131213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc93ba-422b-4800-b12a-f02d94469a7c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.144880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.168309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.169439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.169744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.170033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.170771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:02.171088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.172872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.185626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 371/746] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:02.186439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.203691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353d7d-5fd3-4699-9c69-635282d47163 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.250652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.251422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.251710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.252472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.252872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.254246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.284421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cfee-0160-4af5-ab90-f30ec0d9f9bc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.317514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.318234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.318628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.318753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.319602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:02.320019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.321481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.329069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 376/747] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:02 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:02.329069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.345960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.347179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 372/748] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:02.348170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.382109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.465021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b95215-ae76-40ab-888d-76ee86b9a1c4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.492957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228c14-4353-4dd5-a4a2-f093867967ad None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.505706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.506520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.506807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.507083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.515523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.517109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.532237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:02.532594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:02.533526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:02.534442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:02.534880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.534880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.534880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.538662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 373/749] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:02.539678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.549245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.550798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:02.571419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:02.572369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:02.573316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:02.573316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:02.573316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:02.573316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:02.576944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 377/750] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:02.577814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.653129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.669730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.681077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f1fd7-162a-475d-a4d9-dfe124f34b77 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.704495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0de07-8060-4367-998b-4adcb99b7694 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.727646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.728740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.729263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.729742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.749231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.749908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.750195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.750471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.751527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:02.751844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.753698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.772079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 378/751] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:02.773938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.809311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.811133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.917131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76023c37-5012-48e1-8a3a-5955461aec94 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:02.930953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.941215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.948546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 374/752] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:02.948546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:02.959650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:02.960827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:02.961138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:02.961416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:02.962147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:02.962451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:02.963816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:02.980540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 379/753] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:02.981478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.050342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c24785-e7e1-49cd-b881-1b3c8e8d33dd None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.087329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.087825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b2c95-7284-428d-a865-146c844608e3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.088582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.089112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.089588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.090616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=b0a904e037634da082f8997a47c78a55) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:03.091153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.092888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.099185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 375/754] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/role_assignments?user.id=b0a904e037634da082f8997a47c78a55&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:03.100221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.124382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.125420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.125532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.125787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.138892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.140408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:03.159107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:03.160576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:03.162068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:03.162068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:03.162068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:03.162068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:03.162068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 380/755] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:03.166882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.180594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:03.227049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:03.231137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff0d46-4f93-4c47-99c1-83fabe83ef7d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.280399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.281627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.283464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.284843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.307588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.309538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:03.340538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:03.341652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:03.342580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:03.345251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 376/756] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:03.351579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.400645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4909f5-2d7c-4bae-8f88-9619a7851958 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.525558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.526172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.526459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.526728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.527475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:03.527792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.529219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.555956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 381/757] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:03.561135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.634989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a3f5-2759-4a64-8570-741cdd7bf07c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.669647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:03.695537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.696224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.696562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.696820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.697665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:03.697984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.699585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04631-1e5d-466b-b5a2-3ff4272602b7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.720792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 377/758] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:03.722292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017f13-c227-42a9-8e1c-075065d7125c None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.722590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017f13-c227-42a9-8e1c-075065d7125c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.722876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017f13-c227-42a9-8e1c-075065d7125c None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.724644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 378/759] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:03.725472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12017f13-c227-42a9-8e1c-075065d7125c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.730413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:03.741334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111d53-1725-4e46-8b2d-1d1fd244b3a4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.780009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.781171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.781691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.782188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.789699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.791664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-f74fe825-7268-4e24-9eea-55861f0ca769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:03.809543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:03.810536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:03.811521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 382/760] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:03.812554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.812692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.812974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.831982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:03.833201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:03.856960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12017f13-c227-42a9-8e1c-075065d7125c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:03.904316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:03.905571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:03.905866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:03.906148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:03.920084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:03.921549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:03.928803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 383/761] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:03.928803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:03.958250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:03.959229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:03.960131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:03.960131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:03.960131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:03.960131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:03.960131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 379/762] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:03.964868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:03.998978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.042225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.072696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9659a-93be-4c73-82a6-fdc731cc6228 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.088994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46fbf-3e6b-4691-a24f-608c78293791 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.115403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.116373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.117482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.117986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.119006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.119523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.121204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.124795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.125597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.125883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.126163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] PATH_INFO: `/v3/services/network` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.126827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.128170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.135372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 384/763] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.136441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:04.145255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:04.146285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:04.147129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:04.151551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 380/764] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:03 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:04.152420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.252288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc56ae-a181-4287-8df5-75c9d13d4724 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.259550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.273377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e76e2-41cd-4916-9d0c-357605457878 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.290057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.291297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.291690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.292426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.293245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.293662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.295127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.308757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.311999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.316698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.316939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 385/765] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.316939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.317816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.318793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.318986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=24ea77596372484aaefd59eaad6403ee) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.319313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.321433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.337230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 381/766] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/role_assignments?user.id=24ea77596372484aaefd59eaad6403ee&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.338237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.446558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aac51-41cf-4808-86ba-301d512e6cbf None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.489920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.492644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.492644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.492870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.493632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.493940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.495367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.511735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 386/767] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.516053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.599884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516984c6-e3ab-4d2a-bf14-2cee2fca4d45 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.612974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.652729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9762df-1786-4967-b47b-c796fbd400c2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.666501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.667314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.667604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.667881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.681911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.683367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.693550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.694231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.694518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.694995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.695797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] RBAC: Adding query filter params (type=network) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.696113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.697571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.703520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 387/768] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.709735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:04.712340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:04.713254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:04.714160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 382/769] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:04.721422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:04.748991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.876980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5a1b-1362-43e0-9146-9ee69a8b9e09 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.930221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28a8e-c115-4aee-9190-62faf72efdb7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:04.932950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:04.953242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:04.953970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:04.954195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:04.954469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:04.955274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] RBAC: Adding query filter params (interface=public, service_id=34533a9d06d449e78f37022e686fbe6d, region_id=RegionOne) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:04.955588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:04.958688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:04.968406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 388/770] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/endpoints?service_id=34533a9d06d449e78f37022e686fbe6d&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:04.973816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.002221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.003336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.003883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.004371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.005420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:05.006003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.008598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52959-31cb-48af-bca4-1d177bce16ce None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.022230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 383/771] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:05.024934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3959-943a-44b1-8069-ec4e96a54c9d None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.025513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3959-943a-44b1-8069-ec4e96a54c9d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.026032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3959-943a-44b1-8069-ec4e96a54c9d None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.032221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 384/772] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:05.034444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.035056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.035605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.054865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:05.056770 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:05.103204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44feb-a33a-4d92-aa96-3945f1c889f0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.136841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 385/773] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:05.138215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.141003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:05.143874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.145395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.145688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.145971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.146672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.148643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.155884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 389/774] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:04 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:05.183765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.318735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:05.368893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2586-4b55-4557-9696-e24142d1739a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.372476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494a104-939f-442b-8e3f-f5d421c39571 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.435044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.436289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.436930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.437294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.437729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.438191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.438472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.438746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.439299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.440776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=c0b8fde7b5024cf5b39899fae30a463e, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.441315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.442189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b818-b232-4a83-8ecd-322f97869a08 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:05.457593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:05.458621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:05.459482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:05.462931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 390/775] 10.222.0.57 () {56 vars in 1129 bytes} [Wed May 25 14:40:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:05.470162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.540916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 386/776] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:05 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:40:05.584717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8645-7c87-4018-b481-22427f675ac3 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.585087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8645-7c87-4018-b481-22427f675ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.585337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8645-7c87-4018-b481-22427f675ac3 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.587213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 387/777] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:05.593094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.593434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.593663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.611722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52fa6e-b92d-4f9f-a7e1-a29ce8947254 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.625114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:05.626356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:05.649342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:05.676078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.676801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.677084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.677361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.678085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:05.678398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.680298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.689316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 391/778] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:40:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:05.697635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.744835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:05.763665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 388/779] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:05.795160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.837160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2ae-045e-4c83-b824-b2a0b42cc885 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.874563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.875234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.875545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.875864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:05.876557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:05.876938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:05.878517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:05.907654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 392/780] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:40:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:05.914300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:05.933808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0520-e3ea-4947-9182-3a53d7804b4b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:05.992634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:05.993431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:05.993713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:05.993988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.011819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:06.020911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:06.021858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:40:06.023346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:06.024062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 389/781] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:06.024564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:06.030840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:06.123182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4612-7d95-4fce-ae76-043e382f0a2f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:06.142626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:06.195915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b7072-d606-4833-9446-966d24691f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:06.196586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7072-d606-4833-9446-966d24691f19 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.196892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7072-d606-4833-9446-966d24691f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.197167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7072-d606-4833-9446-966d24691f19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.197968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b7072-d606-4833-9446-966d24691f19 None admin] RBAC: Adding query filter params (interface=public, service_id=a558c45d429642eaa7ae37884e8f95b0, region_id=RegionOne) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:06.198274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b7072-d606-4833-9446-966d24691f19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:06.199650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b7072-d606-4833-9446-966d24691f19 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:06.218531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 393/782] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:05 2022] GET /identity/v3/endpoints?service_id=a558c45d429642eaa7ae37884e8f95b0&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:06.220894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b7072-d606-4833-9446-966d24691f19 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:06.238204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b590-951f-4d67-be78-005eb807b431 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:06.286945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:06.287537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.287819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.288097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.290030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:06.290589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:06.292001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:06.301558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 390/783] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:40:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:06.307466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:06.423883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b7072-d606-4833-9446-966d24691f19 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:06.439228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:06.462810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:06.463620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.464002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.464379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.465211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:06.467095 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:06.476799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 394/784] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:06 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:06.551212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe181b-60f2-4ea8-af18-d513074f75c5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:06.606949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:06.694821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:06.695640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.695920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.696193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.719191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:06.720668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-137b8dc0-490c-49e8-8b50-db3c547feb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:06.744257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:06.745671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:06.746573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:06.746573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:06.746573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:06.746573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:06.749806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 391/785] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:06.755699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:06.870308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1838-37e2-4150-907d-5268f0bd824a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.870602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1838-37e2-4150-907d-5268f0bd824a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.870799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1838-37e2-4150-907d-5268f0bd824a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.872316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 392/786] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:06.873564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3ec3-8f87-4134-a5f3-92387a935c92 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:06.877547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.877839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.878124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.910903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:06.914259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:06.925064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:06.926804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:06.927522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:06.928305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:06.931635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:06.932365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:06.934563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:06.950945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 395/787] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:06.958121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.050599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:07.081122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 393/788] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:07.141610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.242288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d43171-02fd-4908-b3d5-9171b6726887 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.308575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.309401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.309687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.309966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.323735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:07.325488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:07.337991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:07.344187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:07.345204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:07.346659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 396/789] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:07.351800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.354948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba759ed-8600-4b4c-843f-f26a46c1ecb1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.445701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.446536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.446921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.447409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.456553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:07.461511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:07.467319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9df5-301a-41f2-9b19-372565f1d1d2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:07.469478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:07.473652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:07.474499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 394/790] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:07.481233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.524191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.525057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.525357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.525621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.526470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:07.526772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:07.528273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:07.572987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 397/791] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:07.577649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.589333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e807-8ded-4b09-ba80-e8237b898143 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.654101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.655246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.655754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.656227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.657210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:07.657714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:07.659302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:07.682545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 395/792] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:07.689967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23214-1bab-46a5-b032-d30293ddaf3a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.690474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.737688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:07.741324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.742225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.742515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.742796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.764583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:07.766083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:07.812925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:07.813917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:07.814824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:07.814824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:07.814824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:07.814824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:07.814824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 398/793] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:07.822183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9781d-7825-42ae-8b14-c9cdc2ccfd62 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:07.826320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:07.845376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:07.860873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:07.861995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:07.862493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:07.862967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:07.874381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:07.876096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:07.894589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:07.895536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:07.896428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:07.896428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:07.896428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:07.896428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:07.899369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 396/794] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:07.905289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.004345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.030314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a702e-a49f-4a8d-874f-d246fbe2d7db None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.046547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ff59-eb07-4598-9b29-c134ef0c3ad4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.067584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.068253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.068544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.068850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.070146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:08.070462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.071843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096658-d46d-4f56-bfc7-97a4cdbf4f23 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.084305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 399/795] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:08.086183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed6f9-8f78-4c6b-b98d-93984a7cb136 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.086665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed6f9-8f78-4c6b-b98d-93984a7cb136 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.086951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed6f9-8f78-4c6b-b98d-93984a7cb136 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.088469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 400/796] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:08.090165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ed6f9-8f78-4c6b-b98d-93984a7cb136 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.090572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.091177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.091462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.091740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.092478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:08.093070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.095426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62868fa1-ba1c-4b30-95b7-2d92243296bd None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.115985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 397/797] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:08.117651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.117950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.118233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.139047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:08.140323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:08.168531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.210721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ed6f9-8f78-4c6b-b98d-93984a7cb136 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.244631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 398/798] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:08.244631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.253971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.255172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.255662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.256138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.264019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.265762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:08.281250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:08.282198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:08.283114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:08.285640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 401/799] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:08.291285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.320951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.369970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af54e-67dc-4010-a53a-80aeff8faaa0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.400111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e50a-efde-44c4-b206-3116199dd3f6 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.406566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.407363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.407647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.407919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.416975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.418404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.428108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:08.433326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:08.434261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:08.435204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 399/800] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:08.435796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.443795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.444641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.444952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.447602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] PATH_INFO: `/v3/services/network` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.447602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.447602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9e93da7a-533b-463d-ad3c-c71b1ebb2aa9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:08.459443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:08.460470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:08.461656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 402/801] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:08.462465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69133fa-5e53-43f2-b156-d4e55a9f693a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.462465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69133fa-5e53-43f2-b156-d4e55a9f693a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.462465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69133fa-5e53-43f2-b156-d4e55a9f693a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.464046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 403/802] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:08.464808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69133fa-5e53-43f2-b156-d4e55a9f693a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.545407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105814f-7d9f-42cd-94c1-06eecdf00805 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.566974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.580746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.581421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.581704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.581986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.582856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:08.583154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.584631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.592598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69133fa-5e53-43f2-b156-d4e55a9f693a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.604099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 400/803] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:08.605401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.629796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.630509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.630799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.631080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.631964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:08.632296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.633875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf0d4-d5ac-4605-9494-a84e223c5635 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.655730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 404/804] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:08.655730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.655730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.655730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.670605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:08.671809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:08.719471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.723699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691927c-c84e-4cf9-bb92-e8bccffe41d1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.746626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 405/805] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:08.747785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.774622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.775365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.775682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.775966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.776724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] RBAC: Adding query filter params (name=network) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:08.777042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.778416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.783248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 401/806] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:08.783861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:08.831354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:08.871026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dc563-69f7-494e-8023-0135e70d2443 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.897107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e2193-79bd-4da5-a0ff-dc196ce85c98 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:08.908555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.909855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.910346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.910812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/b0a904e037634da082f8997a47c78a55/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.927491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=b0a904e037634da082f8997a47c78a55, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.929416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.934879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:08.935682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:08.935970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:08.936248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:08.947500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:08.949043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:08.967006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:08.968096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 402/807] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:08.969069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.002166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 406/808] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:08 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/b0a904e037634da082f8997a47c78a55/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:40:09.003335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.053579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.104724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.110808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573ed28-f806-4fa2-b892-c92aa04dd260 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.145359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c0bc-947b-45b8-a46b-351a217beb82 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.153986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.155927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.156376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.156831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.176113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:09.187988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:09.189323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:09.190353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:09.191027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.191027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.191027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.191027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.191310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] RBAC: Adding query filter params (type=network) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:09.191310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.191990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.193718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 403/809] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:09.195362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.198682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 407/810] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:09.199516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.317733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.326273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b251450-4245-43e8-9d96-c50fb4dd6ea1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.326683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd50725-984e-4e64-8e8f-81477a6548ef None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.361295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.362350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.362792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.363191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.363378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.363863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.364151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.364428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.364712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:09.365171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.365290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:09.365499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.367526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982aff0-8f2f-462a-9b76-20becd2cc9d2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.367911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.377909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 408/811] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:09.378956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.380679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 404/812] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:09.382182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71211f0-e5bb-4d58-abea-403e1abc0d18 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.382464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71211f0-e5bb-4d58-abea-403e1abc0d18 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.382933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71211f0-e5bb-4d58-abea-403e1abc0d18 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.384652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 405/813] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:09.389463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.389924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.390341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.407516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:09.408727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:09.422332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.485768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 406/814] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:09.486636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.495981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee03b-a01d-4441-89d3-ac372bbcc6f5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.536577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.537271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.537556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.537833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.538630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.540255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.595388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3225-08ba-4af4-a727-3374aa54b87a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.628959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.629757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.630046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.630321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.644638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 409/815] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:09.644638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.647069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.649158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.657905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:09.666827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:09.667809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:09.668782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:09.672994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 407/816] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:09.673993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.686683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.776189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d12c4-81aa-44e6-a206-260ea63f32f0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.825024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731647d0-ccbb-4c9a-b118-3ae6d2290c44 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:09.827190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.829156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.829634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.830106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.845721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.851494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:09.869930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:09.870858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 410/817] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:09.872182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.874962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:09.874962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:09.874962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:09.874962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:09.875527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:09.876794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:09.893048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:09.894015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:09.894866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 408/818] 10.222.0.57 () {56 vars in 1129 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:09.895718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:09.951349 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.979557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:09.997082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823613ae-0fea-4a3c-b1f5-4992fc094a4f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.011099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e7f-91ad-40b6-8488-6ebd8a9e384c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.032088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.032777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.033062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.033335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.034111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:10.034422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.035848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.046175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.046841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.047130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.047407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.048134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:10.048447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.054448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 411/819] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:10.054448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.054781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.066569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 409/820] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:10.071767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.158574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ecb-2285-41e6-a772-7e8d16c39b2d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.173021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df5c4a-aa69-4dad-b2c6-8942cf1d6902 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.178233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.197682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.198378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.198666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.199309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.199733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:10.200052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.201522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.205731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.212368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.212724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 412/821] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:10.214597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.214597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.214781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.218843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/24ea77596372484aaefd59eaad6403ee/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.218843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=24ea77596372484aaefd59eaad6403ee, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.218843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.287913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 410/822] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:10 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/24ea77596372484aaefd59eaad6403ee/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:40:10.289381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.328249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b2d62-fac1-4ae7-be7d-4ae53a57605f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.368030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.369276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.369814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.370193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.381308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.383547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:10.400648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:10.401903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:10.403073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:10.409315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 413/823] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:10.410349 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.432251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd53e-b5aa-48ca-9545-9eb48f54e7cf None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.459475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.476215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.477218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.484829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.484829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.484829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:10.484829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.484829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.486720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 411/824] 10.222.0.57 () {56 vars in 1124 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:10.492882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.519970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6770331-a80f-49f1-b90a-c161a5ad7160 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.561865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.562338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.562548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.562840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.563205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.563958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:10.564439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.565764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.584508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 414/825] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:10.590875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:10.618132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068fc85-619e-4d58-8d96-9d417aa9eb17 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.667872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.669124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.669594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.670055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.671212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.673283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.705601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.708735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c955c0-5d52-4d12-8848-2989bfdef024 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:10.746007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:10.746711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:10.746952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:10.747214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:10.749565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 412/826] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:10.838013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:10.839881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:10.958403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:10.963917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 415/827] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:10.969256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.094732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51a138-5570-4ffc-95da-562d4fb6c75b None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.103229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:11.131342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.132738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.133034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.133317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.144371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.146016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:11.166703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:11.167667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:11.168573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:11.168573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:11.168573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:11.168573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:11.168573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 413/828] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:11.176636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.285540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d4c2-7c33-47b0-bbe2-d686d4f1ed7a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.327182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.327851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.328139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.328420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.329191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:11.329506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.330877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13120-605e-4def-95ee-e7d0b5534885 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.344011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 416/829] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:11.349596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.405105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f480ef-3ddb-4abd-a810-a303297bac56 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.405465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f480ef-3ddb-4abd-a810-a303297bac56 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.405678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f480ef-3ddb-4abd-a810-a303297bac56 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.407347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 417/830] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:11.412343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.412668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.412963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.432039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:11.433285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:11.478924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d003b-9e54-4542-9964-c2d9fa587183 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.500750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:11.516656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 418/831] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:11.537667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.539248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.539539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.539820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.544019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.548639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.550100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:11.566547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:11.567537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:11.568434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 414/832] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:11.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.597611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:11.682896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3b9d2-19bc-40f8-ba4b-d4b6c4c7c43d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.686811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78ae04-0559-4265-95aa-d3356b85c812 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.720501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.721573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.722002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.722450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.724790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.725656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.726014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.726426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.727262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:11.727648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.729278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.734684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:11.742813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:11.743961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:40:11.745042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:11.746788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 415/833] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:11.751827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.752048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 419/834] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:11.753441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:11.807046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:11.832760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:11.856407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5246-88c9-45fb-a936-3cf3368ca40f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.861329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9eef-4821-4172-b379-f58e614fce94 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:11.893655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.894324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.894614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.894897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.895734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:11.896056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.898102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:11.898279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:11.903752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:11.909188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 416/835] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:11.917528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 420/836] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:11.918732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.057474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102878a-7768-4159-8610-ed3b84a45f5d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.096390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.097294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.097591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.097862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.110443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:12.111909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:12.113929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:12.130661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:12.131622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:12.133179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:12.133179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:12.133179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:12.133179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:12.133179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 417/837] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:12.139369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.255334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7b05-a582-404b-b60c-3e0decd01d1e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.269074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:12.294017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.294707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.294999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.295283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.296027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:12.296400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:12.297949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:12.313983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 421/838] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:12.319379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.435251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698d439-4efa-49bc-b3ad-25a149297f8f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.471804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.472638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.472941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.473219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.482188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:12.483637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c17c2e38-e380-4531-9cbd-679866b8e0d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:12.499204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:12.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:12.501159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:12.504714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 418/839] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:12.506486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.601196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593f0b-68ee-4d96-846d-67195c496d88 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.601455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593f0b-68ee-4d96-846d-67195c496d88 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.601896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593f0b-68ee-4d96-846d-67195c496d88 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.603562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 419/840] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:12.612034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.612397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.614313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.625691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b824c-9ed7-43b2-ae86-a44cf5328602 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.637018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:12.638992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:12.673045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.674030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.674327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.674610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.675458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:12.675923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:12.678007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:12.705357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 422/841] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:12.706539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.729676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:12.734202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 420/842] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:12.741582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:12.762601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.859700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93f7-5193-47e9-9e54-1eef08d49f9c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.877160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85529bb-f7e8-41ac-98cd-83f64d7cd318 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:12.906051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.907139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.907868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.908578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.916327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:12.917297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:12.917682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:12.918059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:12.929986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:12.938446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:12.939602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:12.940594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:12.947063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 421/843] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:12.947991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:12.996832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.002455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.004130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.048025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.061449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28411f-3856-4bf5-b2ac-8220f5fa642d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.103784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.104797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.105269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.105762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.106699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:13.107720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.109822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.122242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 422/844] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:13.127420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.144688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 423/845] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:13.147834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.245473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974bc30-1ba2-4314-9ea5-03f8367141b3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.252747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.275207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1ba92-4ca9-4d83-a0af-21445e31315c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.285252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.286222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.286792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.287437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.300564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.302565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.306697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.312987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.314373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.314670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.315035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-6ddcb6ee-2b4a-4d15-b072-b368e30b32cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:13.324458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:13.325362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:13.326269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:13.326269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:13.326269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:13.326269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:13.326269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 423/846] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:13.327083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29d74-9170-4112-9f32-39bc7cd17eb8 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.327083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29d74-9170-4112-9f32-39bc7cd17eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.327317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29d74-9170-4112-9f32-39bc7cd17eb8 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.331117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.332603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 424/847] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:13.332912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.333278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29d74-9170-4112-9f32-39bc7cd17eb8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-5993bcfc-0139-4cef-9511-65ed0e11f3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:13.354260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:13.355266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:13.356161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:13.356161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:13.356161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:13.356161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:13.356161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 424/848] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:13.357200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.357200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.357364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.375458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:13.376975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:13.450476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29d74-9170-4112-9f32-39bc7cd17eb8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.463980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 425/849] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:13.463980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.496715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.497396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.497687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.497969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.498696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:13.499010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.500410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.516526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 425/850] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:13.516526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.543035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.579514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf102b1-08ca-47ca-952f-4d219c8b3def None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.594223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.620192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.621141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.621426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.621944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.623072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:13.623544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.625406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.629071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7590-3c64-4ae5-a4c2-7227347955cc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.638492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 426/851] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:13.643580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.665855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.666668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.666955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.667484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.667877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.669280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:13.682248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:13.683283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:13.684124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 426/852] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:13.684995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.760926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59b19b-6b08-4bb6-835f-14dbfcd72201 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.774059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.793945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c099ef-384a-4c0b-8760-2e1ccd23fbcd None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.800650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.800650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.800650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.800650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.808303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.809995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:13.825297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:13.826255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:13.827233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 427/853] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:13.827826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.834349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.835531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.835960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.836247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.843501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:13.844991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:13.860551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:13.861493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:13.862446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 427/854] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:13.862928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:13.870544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:13.959190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df15804-223f-440f-9af4-18af0988f38e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.984063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f224-a49e-4db2-803a-ae6f5db38868 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:13.997912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:13.998588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:13.998879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:13.999160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:13.999870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.000188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.001596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.007565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 428/855] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.009446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.031550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.032369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.035615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.036027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.037020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.037412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.040931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.065553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.072459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 428/856] 10.222.0.57 () {56 vars in 1135 bytes} [Wed May 25 14:40:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.073684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.142057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.146963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183509-adc7-46ed-9c42-96579737ac91 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.186215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.187209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.187499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.187779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.188589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.188937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.190422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.190615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b15f-5ef7-47ba-9694-a65f6c23eea9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.208517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 429/857] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.208517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.243690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.244349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.244647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.244928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.245635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.245941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.247299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.251978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 429/858] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.252805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.325954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.337916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa59a3-7ac4-4bc1-8948-5b0f6b640f72 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.370219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ab80-fcb1-4602-92ee-2a71a1a76b64 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.393589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.394276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.394559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.394835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.409325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.409998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.410294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.410574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.411421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=b0a904e037634da082f8997a47c78a55) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.411735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.413816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b058-cfb8-44b8-88cf-d4a5c68b5974 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.421785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 430/859] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/role_assignments?user.id=b0a904e037634da082f8997a47c78a55&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.423276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ddb6-cccb-40ec-9dc4-ca2a0c6600e1 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.423685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ddb6-cccb-40ec-9dc4-ca2a0c6600e1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.423972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ddb6-cccb-40ec-9dc4-ca2a0c6600e1 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.425730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 431/860] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:14.426449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.432407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.432753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.433043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.451972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:14.453287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:14.496562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.498029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.546030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 432/861] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:14.568912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.641030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 430/862] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:14.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.646402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.699674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115005-3a74-488d-be5a-c322a6e590f8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.721639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.743580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46253cca-f283-4224-abcf-a482c621940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.744733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253cca-f283-4224-abcf-a482c621940f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.744733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253cca-f283-4224-abcf-a482c621940f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.745025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253cca-f283-4224-abcf-a482c621940f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.746149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46253cca-f283-4224-abcf-a482c621940f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.747087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46253cca-f283-4224-abcf-a482c621940f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-46253cca-f283-4224-abcf-a482c621940f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:14.762904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:14.763998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:14.765122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 433/863] 10.222.0.57 () {56 vars in 1132 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:14.771835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46253cca-f283-4224-abcf-a482c621940f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.786789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c388-f85b-4bde-a665-1eda09402fe3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.826858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.827891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.828249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.828620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.840908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.842585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:14.861526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:14.862507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:14.863411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:14.863411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:14.863411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:14.863411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:14.863411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 431/864] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:14.869300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.887574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46253cca-f283-4224-abcf-a482c621940f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:14.911559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:14.924505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:14.925418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:14.925886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:14.926317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:14.927180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:14.927636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:14.929709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:14.934929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 434/865] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:14.940593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:14.994053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07534-00cf-4b79-bc7f-8e29fa004700 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:15.004924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:15.035185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:15.036243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:15.036782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:15.037375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:15.039075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:15.039617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:15.041608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:15.050918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16587-b99d-4c82-a9ca-a3cbe41cf065 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:15.060263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 432/866] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:15.061499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:15.086650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:15.087352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:15.087603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:15.087888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:15.088604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:15.088974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:15.090440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:15.096700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 435/867] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:15.192710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d7d7-ab82-4114-ba0e-580c9fcc8106 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:15.233638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:15.234904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:15.235423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:15.236589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:15.245652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:15.247460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:15.264651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:15.265643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:15.266561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:15.269393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 433/868] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:15.277375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:15.347885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:15.386945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e1868-9b5e-481d-936a-ace3a2bfabb7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:15.433121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:15.434036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:15.434330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:15.434615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:15.437387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:15.437715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:15.439266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e989-b434-4cfb-a12e-1c29ec24f681 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:15.457757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 436/869] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:15.463625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:15.495885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:15.586112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fff20-0be0-4f87-978c-44bf206ce4c2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:15.621671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:15.622335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:15.622618 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:15.622948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:15.623810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=24ea77596372484aaefd59eaad6403ee) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:15.624127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:15.625576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644f19-2fbe-4977-8f4a-f6a4274953d9 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:15.632074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 434/870] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:15 2022] GET /identity/v3/role_assignments?user.id=24ea77596372484aaefd59eaad6403ee&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:16.609616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c7a6-4691-4c44-bb15-c342bde6a827 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:16.610118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c7a6-4691-4c44-bb15-c342bde6a827 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:16.610118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c7a6-4691-4c44-bb15-c342bde6a827 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:16.611697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 437/871] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:16.617573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0c4a-c7ac-43dd-bdb7-bbd207a9bce5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:16.617965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0c4a-c7ac-43dd-bdb7-bbd207a9bce5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:16.618147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0c4a-c7ac-43dd-bdb7-bbd207a9bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:16.635661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ddad0c4a-c7ac-43dd-bdb7-bbd207a9bce5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:16.636862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ddad0c4a-c7ac-43dd-bdb7-bbd207a9bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:16.706893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 435/872] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:16.730402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c7a6-4691-4c44-bb15-c342bde6a827 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:16.845495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c7a6-4691-4c44-bb15-c342bde6a827 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:16.858220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:16.884148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:16.884858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:16.885151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:16.885435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:16.886182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:16.887577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:16.905672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040916-6226-4a0c-b552-f96fae7a11fe None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:16.906054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040916-6226-4a0c-b552-f96fae7a11fe None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:16.906432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040916-6226-4a0c-b552-f96fae7a11fe None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:16.908100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 436/873] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:16.913631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:16.913928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:16.914347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:16.931968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:16.933215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:16.950426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:16.977425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 438/874] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:16 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:17.018841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 437/875] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:17.043528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.152525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3280eb-7123-4ff7-aaaf-9a04834160ab None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.197890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.198767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.199060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.199341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.211668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:17.220027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:17.221048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:17.221923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 439/876] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:17.228321 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.347447 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa5f5-7df6-4571-98ba-75f88816bc8a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.385048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.386146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.386636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.387128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.388102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:17.388640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:17.390236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2997e-19de-4cda-94de-1bdb6bd97aa8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:17.404874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 438/877] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:17.409693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.445705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:17.522016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122a065-e816-4c8d-b3be-393efc605fba None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.530615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd53db4-4191-438e-80cc-10fda06b0dc0 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.531223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd53db4-4191-438e-80cc-10fda06b0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.531732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd53db4-4191-438e-80cc-10fda06b0dc0 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.534791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 439/878] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:17.540975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.541513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.542042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.560472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:17.561723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.562295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:17.562581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.562876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.563159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.566190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:17.583769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:17.585288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:17.604177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:17.605190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:17.611682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:17.611682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:17.611682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:17.611682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:17.611682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 440/879] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:17.614347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.668214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 440/880] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:17.685732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.714458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:17.737069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8e48-2761-498d-8485-2c81319bf649 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.781298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.782346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.782916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.783412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.784469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:17.785040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:17.786622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:17.800808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 441/881] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:17.808824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:17.830970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48cc5c-caa2-4e97-9772-53cd8fdc98c5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.876662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.877541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.877889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.878174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.879246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:17.880922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a81de-8ad9-4fb7-87f1-1b4dbfc4f1cf None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:17.924009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7404-06fb-4e22-861a-ab438692b7d6 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:17.960548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:17.961393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.961679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.961958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.969139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:17.970565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:17.978787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:17.984751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 441/882] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:17 2022] POST /identity/v3/services => generated 269 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:17.986409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f5e9-2267-491a-873c-e6837fb7fde7 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.986911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f5e9-2267-491a-873c-e6837fb7fde7 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.987427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f5e9-2267-491a-873c-e6837fb7fde7 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5e9940cf-cd42-416c-b454-507587d6d428 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:17.987538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:17.988464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:17.989588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 442/883] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:17.991975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 442/884] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:17.997719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571060-eeb6-406f-b621-672812e10896 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:17.998013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571060-eeb6-406f-b621-672812e10896 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:17.998297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571060-eeb6-406f-b621-672812e10896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:17.999184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f5e9-2267-491a-873c-e6837fb7fde7 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.003595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:18.017374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bb571060-eeb6-406f-b621-672812e10896 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:18.019060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bb571060-eeb6-406f-b621-672812e10896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:18.137332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 443/885] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:18.139122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f5e9-2267-491a-873c-e6837fb7fde7 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.159254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571060-eeb6-406f-b621-672812e10896 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.185326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.186182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.186889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.187265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.188516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:18.189026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.191210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.218391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 443/886] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:18.224872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.296431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:18.299542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571060-eeb6-406f-b621-672812e10896 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.335347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:18.339915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41d26-372c-457f-b3d5-4b058675ef5c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.345411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.346229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.346512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.346788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.347455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.348851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:18.364663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:18.365727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:18.367218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:18.368778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 444/887] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:18.373510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.390371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.391601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.392501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.393016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.477127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.478628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.504982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193275c-0332-468e-b3bf-9d56a6618c76 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.550951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:18.558472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.559397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.562625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.562625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.562625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:18.562625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.564248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.576965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 445/888] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:18.579260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.611193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 444/889] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:18.617604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.654489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:18.708905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f49c6-c560-4813-8c7b-75ec87a7d147 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.746924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.747520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.747806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.748083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.749235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:18.749235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.750504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.764650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 446/890] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:18.773604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32fa2e-af38-49af-b429-b0655f29d7fd None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:18.813833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:18.814693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:18.814987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:18.815265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:18.827712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:18.829352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:18.849819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:18.851803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:18.852743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:18.852743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:18.852743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:18.852743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:18.855216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 445/891] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:18.858307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:18.980944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd68b4-1f31-44b7-b2f4-cb335fecafee None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.005700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.027270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.028290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.028824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.029327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.030258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:19.030803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.032451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.051319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 447/892] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:19.053027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.067153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.160047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911852ad-cf29-4003-aeeb-c1e4c75a67fb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.202872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.204035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.204553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.205078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.213381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.215255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-0884a239-9e30-4f3d-84a2-d5cc85dd82e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:19.231395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:19.232370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:19.233325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:19.236530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 446/893] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:19.242368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.358891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ec2af-d606-41b4-9ed5-6fb8c70dd863 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.368589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2b90-4d53-4823-b633-fe53ec15e195 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.368925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2b90-4d53-4823-b633-fe53ec15e195 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.369215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2b90-4d53-4823-b633-fe53ec15e195 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.370717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 447/894] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:19.378587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.379135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.379639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.396371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.397257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.397552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.397834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.398633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:19.398949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.400383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.403854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:19.405333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:19.416367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 448/895] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:19.423356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.470046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.485116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.500629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 448/896] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:19.515331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.541891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e2c9-9867-4164-93e7-ea5fa6d51289 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.578459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.579121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.579408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.579743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.580600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] RBAC: Adding query filter params (role.id=0be01bc2abe3453a9f71b76b96d41c83, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=b0a904e037634da082f8997a47c78a55) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:19.580940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.582366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.592761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 449/897] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/role_assignments?user.id=b0a904e037634da082f8997a47c78a55&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=0be01bc2abe3453a9f71b76b96d41c83 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:19.643492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff122-dc6a-46f6-b317-385f40cc0a2d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.683976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.684838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.685124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.685405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.686086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.687500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:19.701290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:19.702371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:19.703225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 449/898] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:19.710376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.821413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847ba8-3fbf-446b-80ad-8e3a35142d57 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:19.823850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.856417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:19.857151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:19.857436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:19.857715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:19.858431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:19.858740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:19.860112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:19.865253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 450/899] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:19.871181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:19.944445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:19.985289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd5b9-4fa4-4e08-a0b1-2bd14fb75f1b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:20.023306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:20.023983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.024275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.024557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.025311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:20.025620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:20.027003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:20.032552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 450/900] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:20.038472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:20.143426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c47fe-6a33-42b7-a75d-9931099ad06d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:20.179790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:20.180457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.180774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.181052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.181846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] RBAC: Adding query filter params (interface=public, service_id=86a2e77e9d464f18991c64ce879023a0, region_id=RegionOne) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:20.182158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:20.183521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f0c0b-6a76-4ba7-bf13-8cff04cd5203 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:20.191264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 451/901] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:20 2022] GET /identity/v3/endpoints?service_id=86a2e77e9d464f18991c64ce879023a0&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:20.197312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:20.318711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7ad8-84f4-471c-8cb6-d02454e9c289 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:20.345941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:20.353717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:20.354386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.354671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.354948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.355626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:20.357017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803adbb6-5438-4ae6-9f87-49460af381ba None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:20.365135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 451/902] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:20 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:40:20.455168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89f48-bf19-4a64-8e2c-aaa40fb5e012 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.455482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89f48-bf19-4a64-8e2c-aaa40fb5e012 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.455660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89f48-bf19-4a64-8e2c-aaa40fb5e012 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.457280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 452/903] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:20.465477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.465477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.465477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.482803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:20.484371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:20.561096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 452/904] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:20.586108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd89f48-bf19-4a64-8e2c-aaa40fb5e012 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:20.618596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:20.692216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd89f48-bf19-4a64-8e2c-aaa40fb5e012 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:20.728538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:20.729337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.729592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.729875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.730537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:20.731901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:20.744711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:20.745666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:20.746963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 453/905] 10.222.0.57 () {56 vars in 1132 bytes} [Wed May 25 14:40:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:20.752191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:20.859008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bacd0-8a4d-4293-add7-7bb33a5295ce None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:20.882521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:20.899243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:20.900236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:20.900762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:20.901245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:20.902186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:20.902738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:20.904318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:20.910843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 453/906] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:20.919391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:21.028186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:21.033976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9c645-ae81-4c2d-a15e-60a94f4529d8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:21.068306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:21.069077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.069519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.070018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.070736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:21.071043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:21.072447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048960-ead9-4bc3-9187-2cf9329b2547 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:21.077776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 454/907] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:21.090008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:21.128363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be527441-0f16-4c52-929e-b7eba5d951a2 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.128720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be527441-0f16-4c52-929e-b7eba5d951a2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.128956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be527441-0f16-4c52-929e-b7eba5d951a2 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.130440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 455/908] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:21.137894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.138182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.138463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.161599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:21.163487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:21.201001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85270-b143-4708-bc41-9955d1bb4cd8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:21.254330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 456/909] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:21.258449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:21.259105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.259389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.259662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.260473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] RBAC: Adding query filter params (interface=public, service_id=a2c8da3885f94fc8804ccca734e47410, region_id=RegionOne) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:21.260816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:21.262182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:21.267828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 454/910] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:21 2022] GET /identity/v3/endpoints?service_id=a2c8da3885f94fc8804ccca734e47410&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:21.274051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:21.279937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:21.343318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:21.389994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:21.399903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8bd93-21cb-4399-961f-5114ab732307 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:21.404183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e2a4-3c2d-4ecb-9e8a-31a4239e5353 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:21.437410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:21.438492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.438980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.439480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.440442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:21.442071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3574f4-1630-4221-96db-fd5928616d4a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:21.448375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:21.449071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.449350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.449626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.456845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:21.456845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df9916-f76f-457f-b4da-1e0f556f7999 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:21.457134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 457/911] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:21 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:40:21.550025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 455/912] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:21 2022] POST /identity/v3/services => generated 241 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:21.941316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4a183-899e-412d-85a5-99fa2379d419 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.941869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4a183-899e-412d-85a5-99fa2379d419 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.941869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4a183-899e-412d-85a5-99fa2379d419 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.943508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 458/913] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:21.949052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:21.949481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:21.949672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:21.966952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:21.968122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:22.052725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 456/914] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:22.070902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4a183-899e-412d-85a5-99fa2379d419 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.176702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4a183-899e-412d-85a5-99fa2379d419 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:22.212274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:22.213084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.213376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.213659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.227890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:22.236283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:22.237249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:22.238094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:22.243264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 459/915] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:22.244670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.281188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:22.353955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f9bb-e16f-499c-80c2-1af6418f77fd None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:22.389600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:22.390280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.390570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.390853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.391609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:22.391921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:22.393317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:22.402599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 457/916] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:22.408116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.430604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:22.516908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af32c-1fb2-4722-a1f6-e8d894193027 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:22.556740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:22.557549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.557835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.558114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.569046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:22.570696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:22.589507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:22.590498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:22.591405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:22.591405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:22.591405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:22.591405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:22.591405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 460/917] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:22.597267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.713400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:22.717306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef8de-82c5-4e7c-94de-29ff23583989 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:22.753227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:22.753957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.754247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.754566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.755301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:22.755616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:22.757857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b828b6-87ae-43a0-a286-885882acde2a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:22.771336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 458/918] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:22.777834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.798126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fafb3-95ac-413f-8fad-4a3a0e960763 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.798449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fafb3-95ac-413f-8fad-4a3a0e960763 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.798693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fafb3-95ac-413f-8fad-4a3a0e960763 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.800404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 459/919] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:22.805248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.805544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.805928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.823897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:22.825128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:22.863224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:22.906151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 460/920] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:22.916295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99e75-7d23-4cc7-9cdc-32d68422f8a6 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:22.931462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:22.960491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:22.961719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:22.962422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:22.963309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:22.974869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:22.977105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:22.997813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:22.999007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:23.000173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:23.003386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 461/921] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:23.009115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.041272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.054237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8decc-74dd-4830-9bfe-de45cb2c992e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.091734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.092957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.093450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.093927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.094777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.096401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:23.109409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:23.110465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:40:23.111318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:23.119119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 461/922] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:23.120292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.142851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d1e2-6d86-43c9-86a1-c65fe1a93cd8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.172804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.183434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.184413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.184909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.188288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.188288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:23.188288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.188798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.215290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 462/923] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:23.216708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.261291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf610-1ead-4677-9c09-73e6c93a0175 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.303320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.304082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.304475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.304912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.305742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:23.306186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.307658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.317767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 462/924] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:23.319183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.343552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.359382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ca01-7ae1-4b44-a3b2-6e3adbfc7f0c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.403311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.404391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.404883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.405310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.421004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.423234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.444813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57774e-c7e9-4608-98d7-20a4457d5eb7 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:23.449958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:23.451035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:23.452148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:23.452148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:23.452148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:23.452148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:23.454046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 463/925] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:23.459229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.488481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.489294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.489677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.490324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.490900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:23.491286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.492804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.503092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 463/926] 10.222.0.57 () {56 vars in 1114 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:23.504082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.506829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.605067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.608263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630cb17-8123-4e00-8e16-94a748144a3a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.624846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0a844-f254-4034-8ac7-6e20fee5db0b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.662019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.663985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.665390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.665891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.666059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.667097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.667097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.667473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.667846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:23.668343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.668854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.670217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1c75f-2962-4d01-a70d-ee924e87c82a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.672739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.693261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 464/927] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:23.699563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.757649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 464/928] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:23.770372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31da9-faff-4d2f-9043-0e33e247cb46 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.770745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31da9-faff-4d2f-9043-0e33e247cb46 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.770946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31da9-faff-4d2f-9043-0e33e247cb46 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.773163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 465/929] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:23.778904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577234-7d22-4275-b623-3e949266db71 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.779216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577234-7d22-4275-b623-3e949266db71 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.779497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577234-7d22-4275-b623-3e949266db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.798216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-5f577234-7d22-4275-b623-3e949266db71 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:23.799522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5f577234-7d22-4275-b623-3e949266db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:23.823495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:23.833703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b8ab-1e5b-4ba0-8759-90f17d344d81 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:23.888429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:23.889537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:23.889920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:23.890287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:23.892229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 466/930] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:23.899110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:23.900969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:23.915945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f577234-7d22-4275-b623-3e949266db71 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:23.919176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:23.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:23.921053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:23.924741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 465/931] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:23.934841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.002476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.047846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f577234-7d22-4275-b623-3e949266db71 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.051503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9996-f5f3-4ba3-911c-836a743cdcf7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.083281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.084991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.085489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.085768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.086456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.087787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.090197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.091049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.091479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.091914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.092866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:24.093322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.094880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-40bb6754-9f76-4de7-8d10-2fed89deafc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:24.100562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:24.101557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:40:24.102414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:24.106939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 467/932] 10.222.0.57 () {56 vars in 1132 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:24.107970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28c45-acf7-40d7-81da-f703cfd4de1c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.108264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28c45-acf7-40d7-81da-f703cfd4de1c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.112841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28c45-acf7-40d7-81da-f703cfd4de1c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.112964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 466/933] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:24.112964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.113118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 468/934] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:24.115666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.116086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.117189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.130391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.133601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:24.134794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:24.208702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 469/935] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:24.208702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.247480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4d41-6414-47ec-86e0-bb0479ca6cb5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.274651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.284221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.290966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.293936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 467/936] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:24.294734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.323150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130d5d8-eae4-4117-8ba6-33f016b638da None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.362076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.363377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.363906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.364391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/b0a904e037634da082f8997a47c78a55/roles/0be01bc2abe3453a9f71b76b96d41c83` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.367085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=b0a904e037634da082f8997a47c78a55, role_id=0be01bc2abe3453a9f71b76b96d41c83)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.368827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.378053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.402236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd7fa-fc7f-4a18-890e-137e559c1635 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.435810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.436629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.436929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.437207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.437861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.439223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:24.451863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:24.453017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:24.453941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 468/937] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:24.454818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.471043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 470/938] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:24 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/b0a904e037634da082f8997a47c78a55/roles/0be01bc2abe3453a9f71b76b96d41c83 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:40:24.472175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.590585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3e21-1ba4-413c-b523-02566667da1e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.630181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614305d9-eba2-42b3-940c-d088dbb3d250 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.632155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.632962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.633251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.633536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.634395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:24.634707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.636195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.646538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 469/939] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:24.649402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.654292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.670739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.692266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.693359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.693915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.694564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.695515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:24.698710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.700107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.706556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 471/940] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:24.713977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.780960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2529-ec53-4715-84f6-0562966a50e7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.822806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.823877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.824655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.825119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.826089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.828120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.843501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aa2b9-e101-4235-9057-f261c4e27a4c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:24.885794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:24.886608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:24.886900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:24.887185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:24.887973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:24.888294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:24.890364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:24.897966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 472/941] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:24.902471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:24.961977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:24.984689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 470/942] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:25.038607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0271ad-1a5f-486d-86ac-0cd11c809b3c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:25.088550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:25.089300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:25.089552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:25.089833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:25.090639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] RBAC: Adding query filter params (interface=public, service_id=5881e1a5fdcf4cf69f252086a0607603, region_id=RegionOne) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:25.090958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:25.092356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862e645-b2c1-4f39-8002-06c62bc3530b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:25.098621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 473/943] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:24 2022] GET /identity/v3/endpoints?service_id=5881e1a5fdcf4cf69f252086a0607603&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:25.105789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:25.175211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:25.221897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a37b5-1ecd-4247-a0ff-53c3d3a24af0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:25.264294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:25.265013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:25.265777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:25.266057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:25.266747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:25.268114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb53f34-65ac-49ff-939c-3edd5a5ff39c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:25.275446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 471/944] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:25 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:40:26.111817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed7ea7-91ca-4588-bd43-f37be795cc9e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.112335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed7ea7-91ca-4588-bd43-f37be795cc9e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.112447 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed7ea7-91ca-4588-bd43-f37be795cc9e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.114257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 474/945] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:26.120375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.120827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.120974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.138729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:26.139898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:26.216730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 472/946] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:26.236761 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed7ea7-91ca-4588-bd43-f37be795cc9e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:26.356132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed7ea7-91ca-4588-bd43-f37be795cc9e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:26.367581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:26.395332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:26.396330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.396881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.397928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.398866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:26.400571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:26.402189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING keystone.server.flask.common [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 14:40:26.456230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.sql.core [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:40:26.456230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:40:26.456230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [parameters: {'id': 'a1dfbee291f941e3b30ee64fecabe03b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:40:26.456230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dfbee291f941e3b30ee64fecabe03b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dfbee291f941e3b30ee64fecabe03b. May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application conn.query(q) May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:40:26.474423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result.read() May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 14:40:26.476436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application next(self.gen) May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application yield resource May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application next(self.gen) May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise self.value May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application session.commit() May 25 14:40:26.477461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.session.flush() May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application compat.raise_( May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:40:26.479422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:40:26.481635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application conn.query(q) May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result.read() May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:40:26.483575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [parameters: {'id': 'a1dfbee291f941e3b30ee64fecabe03b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:26.485803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:26.489445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dfbee291f941e3b30ee64fecabe03b. May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:26.492805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 475/947] 10.222.0.57 () {60 vars in 1140 bytes} [Wed May 25 14:40:26 2022] POST /identity/v3/projects => generated 262 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:26.498536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:26.555324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:26.608526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03f6f0-8b16-49ab-93b4-f7542ae9cb27 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:26.643779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:26.644579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.644889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.645168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.652844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:26.654297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5c1c1df1-8402-47ad-b332-d28d9e21cbc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:26.668513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:26.670619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:26.672795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 473/948] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:26.675824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:26.787232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185aae-d414-4f73-aaa1-fd652b98e1cd None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:26.827863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:26.828533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.828853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.829134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.829897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:26.830270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:26.831965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf0ecc-6d3f-4a61-8d08-659a32e1dc95 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:26.852809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 476/949] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:26.925206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b33c-0d61-41b2-9d1c-09ea94206042 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.925619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b33c-0d61-41b2-9d1c-09ea94206042 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.926019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b33c-0d61-41b2-9d1c-09ea94206042 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.927839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 474/950] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:26.934318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:26.934608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:26.934892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:26.953973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:26.955722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:26.978938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:27.038505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 477/951] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:27.062512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2b33c-0d61-41b2-9d1c-09ea94206042 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.176422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2b33c-0d61-41b2-9d1c-09ea94206042 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:27.193216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:27.217233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900000-4155-455a-b900-533ccc35638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:27.218067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900000-4155-455a-b900-533ccc35638f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.218401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900000-4155-455a-b900-533ccc35638f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.218681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900000-4155-455a-b900-533ccc35638f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.231266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900000-4155-455a-b900-533ccc35638f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-42900000-4155-455a-b900-533ccc35638f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:27.240078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:27.241762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:27.242668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 475/952] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:27.247851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.382850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c168f1-f3ce-4503-aa21-be5b98d9f743 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:27.448478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:27.450061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.450832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.451599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.453339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:27.454156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:27.456811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:27.473502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 478/953] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:27.474821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264d51-a1a7-4b5d-bf60-6dca7bcabb05 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.475252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264d51-a1a7-4b5d-bf60-6dca7bcabb05 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.475654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264d51-a1a7-4b5d-bf60-6dca7bcabb05 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.483294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 476/954] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:27.485064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.485657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f630-4b9b-439f-8644-5600dbef363a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.486170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f630-4b9b-439f-8644-5600dbef363a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.486719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f630-4b9b-439f-8644-5600dbef363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.513929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a3e5f630-4b9b-439f-8644-5600dbef363a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:27.515843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a3e5f630-4b9b-439f-8644-5600dbef363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:27.517657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:27.640974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 477/955] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:27.642519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616bb0-5890-4bf1-9c45-e25ef42a2e58 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.642811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616bb0-5890-4bf1-9c45-e25ef42a2e58 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.643163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616bb0-5890-4bf1-9c45-e25ef42a2e58 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.644585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 478/956] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:27.651123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.651409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.651688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.663236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5492-f034-4241-ad59-81ae47f1583e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:27.671892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:27.673116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:27.701364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:27.702250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.702870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.703159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.716148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:27.718482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:27.739371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:27.740393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:27.742418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:27.742418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:27.742418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:27.742418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:27.742418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 479/957] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:27.745886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.751690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 479/958] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:27.757671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.800873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:27.821306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:27.855711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018361-ea38-47e6-bda7-f6ef12342df2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:27.877393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9edb4-44b6-49fc-a844-5da3ff10955c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:27.898096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:27.898903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.899187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.899462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.900119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:27.902137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:27.915420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:27.916171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:27.916528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:27.916915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:27.917646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:27.917959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:27.919396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:27.919848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:27.920929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:27.921791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 480/959] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:27.923363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:27.943037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 480/960] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:27.943037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.048855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9754-5ec0-4e8e-b55c-ba0c3650c91b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.049708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.056981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb39b9-5892-4cb7-a7f9-a7de0f9eb558 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.080451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.085979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.086788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.087069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.087390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.087985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.089727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.095307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.095981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.096273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.096556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.097313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:28.097627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.099025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:28.101835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:28.102897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:28.103738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 481/961] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:28.105660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.116282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 481/962] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:28.116282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.221578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f585-aff6-4ee9-8905-c63d8a1af897 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.225963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93d0a-3557-4a57-9995-15bd90f1847a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.262544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.263219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.263508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.263793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.264506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:28.264849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.266220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.269770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.271117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.271227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 482/963] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:28.272301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.272531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.273326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.284392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.286026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.300602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:28.306484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:28.313188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 482/964] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:28.314173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.371181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.383959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d729e1-f6bb-4fcd-b32c-dd5664b9c0d5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.416546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0572c37-cd8a-4a51-b535-bd7b5cf027c4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.420304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.421067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.421428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.421775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.422570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:28.422886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.424247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.429592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 483/965] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:28.430372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.467017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.467701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.467987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.468267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.469033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:28.469348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.470959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.482288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 483/966] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:28.483239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.561129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.585694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758147ae-2dba-401b-af19-0dd40de92b01 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.610636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfd7e-fdec-4df3-8e4d-f7c19b1887b0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.627556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.628534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.628859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.629139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.630357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:28.631112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.634031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.639702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.653227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 484/967] 10.222.0.57 () {56 vars in 1149 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:28.658478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:28.659440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.660109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.660395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.663368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.663368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.663664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:28.764762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242601f-3e99-46e1-a762-350f3d747c7f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:28.775554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 484/968] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:28.823898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:28.824987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:28.825602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:28.826111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:28.840140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:28.911473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:28.913970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fa50a-b246-4a86-abd0-6844799884a1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.028740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 485/969] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:40:29.037929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.149244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb1f7-2b61-4b6c-801f-ba8c31ccd268 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.185427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.186235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.186522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.186805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.198180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.199650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-46e1d45f-d41c-4853-947e-c8baa56f7a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:29.223397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:29.224352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:29.226186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:29.226186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:29.226186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:29.226186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.226582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0770b-1ffe-41da-a673-b43734679351 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.226582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0770b-1ffe-41da-a673-b43734679351 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.226582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0770b-1ffe-41da-a673-b43734679351 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.227135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 485/970] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:29.227209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 486/971] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:29.234020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.234315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.234603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.237020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0770b-1ffe-41da-a673-b43734679351 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.254951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:29.256538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:29.285120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.302680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.340813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 486/972] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:29.368281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.383204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0770b-1ffe-41da-a673-b43734679351 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.421516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f743b-fac3-4df0-be50-628034313916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.422632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f743b-fac3-4df0-be50-628034313916 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.423115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f743b-fac3-4df0-be50-628034313916 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.423588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f743b-fac3-4df0-be50-628034313916 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.424503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f743b-fac3-4df0-be50-628034313916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:29.425155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f743b-fac3-4df0-be50-628034313916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.426719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f743b-fac3-4df0-be50-628034313916 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.439681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 487/973] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:29.447873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f743b-fac3-4df0-be50-628034313916 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.475943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c8426-4aa3-4a55-95b0-f65777d281cb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.512714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.513559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.513853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.514182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.514902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.516513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.546990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.549903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f743b-fac3-4df0-be50-628034313916 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.570693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.sql.core [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:40:29.570693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:40:29.570693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [parameters: {'user_id': '49e4708dc6584908b2e46976cfd3d7ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:40:29.570693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application conn.query(q) May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result.read() May 25 14:40:29.581654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:40:29.582584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application next(self.gen) May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application yield resource May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application next(self.gen) May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise self.value May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application session.commit() May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:40:29.583553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.session.flush() May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application compat.raise_( May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:40:29.585007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:40:29.586502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application conn.query(q) May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application result.read() May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:40:29.588403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [parameters: {'user_id': '49e4708dc6584908b2e46976cfd3d7ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:29.590491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 14:40:29.592639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:40:29.595741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.596578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.596578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.596578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.596578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.597760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.598241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 487/974] 10.222.0.57 () {60 vars in 1131 bytes} [Wed May 25 14:40:29 2022] POST /identity/v3/users => generated 160 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:29.598836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.604166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:29.621785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:29.622778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:29.623724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:29.628412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 488/975] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:29.630712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.647072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.763463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0e34-9c2b-410f-b9e4-1334e32f6521 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.776253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68960-6371-41cc-bb2f-901f0850180d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.814141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.815278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.815700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.816276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.816782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:29.817716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:29.818093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:29.818550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:29.819594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:29.820468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.821891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.826016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:29.827819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:29.840604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 489/976] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:29.841643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:29.846437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:29.847554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:40:29.848744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:29.851272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 488/977] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:29.857534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:29.871928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.961144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d3f1-a0df-4a8f-aec5-705a73bc5cd2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:29.974778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:29.997473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea6d7-f7d2-47eb-ba9a-c038e84d6663 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:30.017887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:30.019749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:30.020737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:30.021232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:30.023758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] RBAC: Adding query filter params (role.id=0be01bc2abe3453a9f71b76b96d41c83, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=b0a904e037634da082f8997a47c78a55) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:30.024526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:30.026888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f49c1-a786-49d4-b367-1a3c31e0c77e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:30.034233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:30.034907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:30.035189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:30.035462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:30.040930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:30.040930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:30.040930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd84520-d72c-4516-ba07-dcc336affe64 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:30.041596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 490/978] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/role_assignments?user.id=b0a904e037634da082f8997a47c78a55&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=0be01bc2abe3453a9f71b76b96d41c83 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:30.081599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 489/979] 10.222.0.57 () {56 vars in 1101 bytes} [Wed May 25 14:40:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:30.816370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800d36-4e41-44d9-8154-037f25759e92 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:30.816950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800d36-4e41-44d9-8154-037f25759e92 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:30.816950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800d36-4e41-44d9-8154-037f25759e92 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:30.818320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 491/980] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:30.823864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f6b2-eb57-4f3f-9d9c-0e150e17541a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:30.824304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f6b2-eb57-4f3f-9d9c-0e150e17541a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:30.824488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f6b2-eb57-4f3f-9d9c-0e150e17541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:30.842177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-67b9f6b2-eb57-4f3f-9d9c-0e150e17541a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:30.843725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-67b9f6b2-eb57-4f3f-9d9c-0e150e17541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:30.923327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 490/981] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:30.945624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1800d36-4e41-44d9-8154-037f25759e92 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.034880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:31.052046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473dae5-309f-4b05-9e4c-7d03982b8f95 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.052439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473dae5-309f-4b05-9e4c-7d03982b8f95 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.052551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1800d36-4e41-44d9-8154-037f25759e92 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.052690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473dae5-309f-4b05-9e4c-7d03982b8f95 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.054324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 491/982] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:31.059522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.059819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.060105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.077153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:31.078264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:31.091714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.092382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.092697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.093145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.093810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.095220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.139748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:31.146203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 492/983] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:31.168767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 492/984] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:30 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:31.170899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.282849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b50ee-8ff4-43a6-824a-8a5d86bc837b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.328276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.329045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.329336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.329614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.330275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.331664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:31.345116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:31.346265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:31.347279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 493/985] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:31.353999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.466990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f9ba-22b2-48b8-a928-a1e06a05fd11 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.500779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.501442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.501727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.502003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.502700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:31.503007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.504360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.510981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 493/986] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:31.516392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.575412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:31.617547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb29e3-fa1f-4bfb-b1f7-ec613268c03c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.651424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.652089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.652375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.652676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.653376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:31.653682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.655045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.660185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 494/987] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:31.666749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.679813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:31.772281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1586-0ace-4719-b830-68da583f438c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.806963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.807866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.808295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.808773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.809752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] RBAC: Adding query filter params (interface=admin, service_id=5881e1a5fdcf4cf69f252086a0607603, region_id=RegionOne) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:31.810210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.811705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1752f9-994d-4371-86e8-e7ca3afd3eaf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.817494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 494/988] 10.222.0.57 () {56 vars in 1249 bytes} [Wed May 25 14:40:31 2022] GET /identity/v3/endpoints?service_id=5881e1a5fdcf4cf69f252086a0607603&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:31.823460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:31.927139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd682f8-aabe-4220-a43b-fbe0418a81de None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:31.950125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:31.961944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:31.962618 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:31.962907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:31.963249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:31.963877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:31.965283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b348e-fea6-4407-bd0e-c1f467a6e700 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:31.971800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 495/989] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:31 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:40:32.365048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698599fc-cd63-4d0d-8d9d-dbe27538a376 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:32.365511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698599fc-cd63-4d0d-8d9d-dbe27538a376 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:32.365643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698599fc-cd63-4d0d-8d9d-dbe27538a376 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:32.367164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 495/990] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:32.372417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:32.372753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:32.373043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:32.390231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:32.391409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:32.459211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 496/991] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:32.481907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698599fc-cd63-4d0d-8d9d-dbe27538a376 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:32.557161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:32.587194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698599fc-cd63-4d0d-8d9d-dbe27538a376 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:32.621275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:32.622056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:32.622338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:32.622611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] PATH_INFO: `/v3/services/image` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:32.623258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:32.624645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:32.636296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:32.637369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:32.643190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 496/992] 10.222.0.57 () {56 vars in 1105 bytes} [Wed May 25 14:40:32 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:32.645711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:32.752734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a55ba-e580-4dd0-a665-f79139c85a0c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:32.770611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:32.788938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:32.789882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:32.790168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:32.790445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:32.791156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] RBAC: Adding query filter params (name=image) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:32.791559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:32.792912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92064-cc1d-41a7-aacf-e906d34a9f4f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:32.803545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 497/993] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:32.805317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:32.910150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f027b74-c94f-4f9f-8816-7a9f02fa3118 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:32.946917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:32.947583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:32.947873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:32.948159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:32.948903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] RBAC: Adding query filter params (type=image) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:32.949217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:32.950572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9baa-ff77-440f-898e-db5e6678d799 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:32.952982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:32.956360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 497/994] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:33.517599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29273-80ce-4345-9e6e-d50f68dbfceb None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:33.518106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29273-80ce-4345-9e6e-d50f68dbfceb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:33.518106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29273-80ce-4345-9e6e-d50f68dbfceb None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:33.520535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 498/995] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:33.525548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:33.525847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:33.526214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:33.543472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:33.544680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:33.620761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 498/996] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:33.638167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a29273-80ce-4345-9e6e-d50f68dbfceb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:33.748409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a29273-80ce-4345-9e6e-d50f68dbfceb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:33.786082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:33.786811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:33.787837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:33.788292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:33.788995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:33.790638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:33.803105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:33.804111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:33.809453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 499/997] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:33.812261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:33.916344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e8087-f688-4602-a51c-8b93b8ecf5c3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:33.945482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:33.951624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:33.952294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:33.952582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:33.952890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:33.953597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:33.953905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:33.955420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:33.960716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 499/998] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:33.966087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.013432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:34.070636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a0ed-3007-4829-97cf-75848e34412e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.109400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.110092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.110378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.110661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.111377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:34.111691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.113128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7d9e-b7d6-4221-a8be-ee67cdab1034 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.119847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 500/999] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:34.126475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.243790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29e964-dee4-4a4f-bf5a-ed202cdc6de1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.279620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.280283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.280573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.280883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.281675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] RBAC: Adding query filter params (interface=public, service_id=67b75b97a3944c119542a76c12a84fa3, region_id=RegionOne) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:34.282263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.283450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.283803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1f28-8aa4-4b0b-9dfd-ef2fecf771a3 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.284099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1f28-8aa4-4b0b-9dfd-ef2fecf771a3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.284383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1f28-8aa4-4b0b-9dfd-ef2fecf771a3 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.285924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 501/1000] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:34.290714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 500/1001] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:34 2022] GET /identity/v3/endpoints?service_id=67b75b97a3944c119542a76c12a84fa3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:34.292091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.292454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.292879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.295669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.313200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:34.315136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:34.358266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:34.393317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 502/1002] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:34.400149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16e80-781d-422d-a9b4-03a48dc08306 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.417225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.436152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.436847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.437135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.437522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.438188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.439546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.456652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 501/1003] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:34 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:40:34.472547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:34.543255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997741a-8874-447e-8712-4bd4d08d39c4 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.581727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.582560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.582851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.583133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.583808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.586026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:34.599058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:34.600325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:40:34.601235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:34.606003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 503/1004] 10.222.0.57 () {56 vars in 1126 bytes} [Wed May 25 14:40:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:34.607315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.719047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9c592-f909-46b3-801c-1d82f8a08cc5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.743013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:34.754339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.755013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.755301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.755583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.757176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:34.757587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.758956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.768651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 502/1005] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:34.769780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:34.876136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a93b-b86e-4204-8038-08fef34e40c5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:34.877719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:34.911403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:34.912779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:34.913175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:34.913646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:34.914671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:34.915032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:34.916410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6be2-2f1f-43ef-a7e9-40dc328b7b11 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:34.926183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 504/1006] 10.222.0.57 () {56 vars in 1122 bytes} [Wed May 25 14:40:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:34.927138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:35.037080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822681a2-8b3e-4ee1-a061-4f9713e689a1 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:35.073745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:35.074650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.075087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.075513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.076429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:35.077961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05567e-8d26-43ac-9d5f-a93be06e7355 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:35.160812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 503/1007] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:35.191801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462585-ca07-43c2-9e3b-9d4a69e5310e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.192094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462585-ca07-43c2-9e3b-9d4a69e5310e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.192383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462585-ca07-43c2-9e3b-9d4a69e5310e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.194090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 505/1008] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:35.199927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d683e8-0787-49f6-b9bb-13b5d414ee55 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.200219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d683e8-0787-49f6-b9bb-13b5d414ee55 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.200500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d683e8-0787-49f6-b9bb-13b5d414ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.223191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f0d683e8-0787-49f6-b9bb-13b5d414ee55 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:35.224555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f0d683e8-0787-49f6-b9bb-13b5d414ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:35.276009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:35.315340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 504/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:35.334821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462585-ca07-43c2-9e3b-9d4a69e5310e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:35.445942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462585-ca07-43c2-9e3b-9d4a69e5310e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:35.480564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:35.481265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.481555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.481840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.482574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:35.483953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51332fe-7e6e-4801-9f5e-2941221a4fe2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:35.592212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 506/1010] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:35 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:36.697270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0ecb-7abd-452e-84ac-62c291622bd8 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.697814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0ecb-7abd-452e-84ac-62c291622bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.697814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0ecb-7abd-452e-84ac-62c291622bd8 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.699348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 505/1011] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:36.704726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.705224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.705301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.722817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:36.724015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:36.746108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:36.803460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 507/1012] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:36.826304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0ecb-7abd-452e-84ac-62c291622bd8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:36.934554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0ecb-7abd-452e-84ac-62c291622bd8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:36.971848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:36.973029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.973525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.974022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.975009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:36.976634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:36.988552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:36.989684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:40:36.990692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:36.992761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 506/1013] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:36.996536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.097163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e4968-8ee3-4276-96dd-9791350d0311 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:37.131421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:37.132036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.132324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.132633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.133333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:37.133643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:37.135010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:37.144550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 508/1014] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:37.145815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.182369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:37.263924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d70-5451-4898-912c-1a85b41027eb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:37.298832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:37.299881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.300389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.300927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.301842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:37.302373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:37.304592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73854e9-0472-400a-8ded-302a2721fad8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:37.310146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 507/1015] 10.222.0.57 () {56 vars in 1112 bytes} [Wed May 25 14:40:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:37.315466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.334866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:37.410132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e182-1293-4d42-b291-a547bc8236fd None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.410429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e182-1293-4d42-b291-a547bc8236fd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.410711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e182-1293-4d42-b291-a547bc8236fd None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.412114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 508/1016] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:37.417579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.417871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.418152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.419016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ad66-9cf8-406c-988c-b40fba39ee3e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:37.437505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:37.438688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:37.460091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:37.460794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.461103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.461367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.462109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:37.463486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:37.506618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 509/1017] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:37 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:37.530557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.548641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 509/1018] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:37.564884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:37.646956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62d22-832f-40d0-9cee-a8fdf4f40a14 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:37.692196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:37.693637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.693905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.694179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.695510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:37.697010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1105368-3583-4c42-8c34-b2431a2ec9dd None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:37.698693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 510/1019] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:37.704561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.780288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:37.810989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588198a-9ae0-4094-a064-27121281a2b2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:37.818677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64fe3-4deb-44a3-8f06-f7d916394d73 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.819083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64fe3-4deb-44a3-8f06-f7d916394d73 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.819364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64fe3-4deb-44a3-8f06-f7d916394d73 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.821668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 511/1020] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:37.827142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.827439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.827719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.846562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:37.847763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:37.854488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:37.855168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:37.855457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:37.855725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:37.856924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:37.858747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:37.922024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 512/1021] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:37.940251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 510/1022] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:40:37 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:37.945839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:37.973849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:38.060682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bb925-a022-485e-be79-2ae9f0712e19 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:38.098410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:38.099218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:38.100214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:38.100488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] PATH_INFO: `/v3/services/image` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:38.101190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:38.102574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:38.115029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:38.116184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:38.117111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:38.120766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 513/1023] 10.222.0.57 () {56 vars in 1105 bytes} [Wed May 25 14:40:37 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:38.122530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:38.241752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e71a-97c6-48c3-82f4-4ad71ca7889d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:38.266333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:38.277487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:38.278165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:38.278511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:38.278746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:38.279611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] RBAC: Adding query filter params (name=image) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:38.279923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:38.281316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:38.286626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 511/1024] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:38.293352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:38.386322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:38.399176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680edcd-1a0f-4ef4-bcf9-3dfc60b6d28c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:38.434212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:38.434889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:38.435178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:38.435460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:38.436181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] RBAC: Adding query filter params (type=image) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:38.436496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:38.437895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:38.448255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 514/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:38.449573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:38.552938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add59d-218c-46ec-a75d-3acb69d7b31e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:38.586541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:38.587206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:38.587495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:38.587776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:38.588559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] RBAC: Adding query filter params (interface=public, service_id=b03af904fa5f47b2b722849ce9de4713, region_id=RegionOne) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:38.588899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:38.590268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979886a7-fd5b-40fa-861d-b7572b7df5e3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:38.600234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 512/1026] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:40:38 2022] GET /identity/v3/endpoints?service_id=b03af904fa5f47b2b722849ce9de4713&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:38.601423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:38.701198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4427c8-2248-42f3-a94f-e2173ca54a3e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:38.734884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:38.735554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:38.735842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:38.736123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:38.736834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:38.738203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef09b29-123d-4d2b-afb9-787195506aa9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:38.752644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 515/1027] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:40:38 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:40:39.972549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80168be-60ce-4a7c-b2d3-cf1b275e4838 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:39.973125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80168be-60ce-4a7c-b2d3-cf1b275e4838 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:39.973125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80168be-60ce-4a7c-b2d3-cf1b275e4838 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:39.974698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 513/1028] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:39.980258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518dd6-6d01-412d-820d-2d75462cccbe None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:39.980700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518dd6-6d01-412d-820d-2d75462cccbe None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:39.980895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518dd6-6d01-412d-820d-2d75462cccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:39.997716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bf518dd6-6d01-412d-820d-2d75462cccbe None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:39.998909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bf518dd6-6d01-412d-820d-2d75462cccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:40.010825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.072944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 516/1029] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:40.097000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80168be-60ce-4a7c-b2d3-cf1b275e4838 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.153527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.202339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80168be-60ce-4a7c-b2d3-cf1b275e4838 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.218442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e135-ba33-4d79-b05d-49524f62c0a4 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.218741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e135-ba33-4d79-b05d-49524f62c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.219016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e135-ba33-4d79-b05d-49524f62c0a4 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.220400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 517/1030] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:40.226095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.226330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.226619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.244566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.245421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.245708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.245977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.250213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:40.251458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:40.257319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:40.265537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:40.266496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:40.267347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 514/1031] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:40.273817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.328492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 518/1032] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:40.352863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.386443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3810e-027a-4776-9c94-b4e99dd8b607 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.400941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.422499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.423172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.423455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.423731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.424473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:40.424810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.426191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.439692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 515/1033] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:40.440560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.441404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.466353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34c95-f711-4491-aeeb-54bef6205fd2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.502707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.503422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.503712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.503992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.505199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.506685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.508306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 519/1034] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:40.513960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.561342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943768c-4248-4c6d-b508-4ffb7e97f06a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.597059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.598152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.598586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.599008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.610944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.612669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.619826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28014-fd88-4a79-b826-bd44610793f0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:40.631839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:40.632912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:40.633808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:40.633808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:40.633808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:40.633808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:40.634119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 516/1035] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:40.639468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.656995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.657664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.657948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.658224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.658920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.660341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.668158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.739440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138061b0-ca4d-48e9-ba54-fa96dcbb4724 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.773688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.774289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.774578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.774859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.775237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:40.775579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:40.775901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.777310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.781382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 520/1036] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:40:40 2022] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:40.792581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 517/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:40.798751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:40.913011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a6c5e-2314-4c4b-8a09-f7b5b319f04f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:40.950521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:40.951344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:40.951635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:40.951920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:40.960829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:40.962293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ea35b971-349e-4c2f-b33d-33dcce6410f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:40.978398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:40.983387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:40.984358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 521/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:40.986401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.008216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d36dd-fde4-4a8a-a61b-cf4c9365a9ab None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.008518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d36dd-fde4-4a8a-a61b-cf4c9365a9ab None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.009156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d36dd-fde4-4a8a-a61b-cf4c9365a9ab None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.010786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 522/1039] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:41.015828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.016117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.016395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.040001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:41.040001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:41.096208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.101474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.111374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb300-00b0-43a4-9f41-89388c751fdc None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.113210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 523/1040] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:41.137400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.147903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.148736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.149029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.149308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.150217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:41.150535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.152033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.171413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 518/1041] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:40:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:41.176789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.255065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709bde-3be3-4f0c-bd2e-a2cd229b1378 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.283109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f60b-1f30-4adc-b39e-ddfb38e65d64 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.291113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.291844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.292135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.292417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.293102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.294557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:41.307020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:41.308452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:40:41.309510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:41.313321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 524/1042] 10.222.0.57 () {56 vars in 1105 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:41.314074 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.324506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.325357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.325653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.325938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.342344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.375641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.401483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.402954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.421802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ebe53-2462-401c-904b-5b00a8692ae6 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.465830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.466502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.466787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.467062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.467770 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:41.468073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.469462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.479769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 525/1043] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:41.482060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.513070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 519/1044] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:40:41.518476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.565960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.594106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11692e-c252-47eb-9581-7215d718e1a3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.611929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.625020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9fec-9c7a-4641-8dca-87e0bb97ba95 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.629614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.630286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.631188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.631463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.632176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] RBAC: Adding query filter params (type=image) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:41.632480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.634007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.639520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 526/1045] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:41.644780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.664903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.665695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.665977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.666253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.676396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.678008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:41.699425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:41.700411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:41.701433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:41.701433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:41.701433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:41.701433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:41.701433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 520/1046] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:41.706491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.752507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf946-9087-403c-a9e4-a1708e82b4bf None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.789559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.790309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.790667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.791013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.791908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.793290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.805573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:41.811161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16a3b-bbed-449f-a60c-e5ef15c5f32d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:41.845261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:41.845846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:41.846130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:41.846406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:41.847120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:41.847428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:41.848810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:41.860073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 521/1047] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:41.866085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:41.925987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 527/1048] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:40:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:40:41.985105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a3023-d66b-47cb-b5d6-b5d7cfacbac1 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:42.030269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:42.031186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:42.031482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:42.031764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:42.040497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:42.042030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:42.057701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:42.058685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:42.059628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:42.060954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 522/1049] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:42.065040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:42.113947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:42.188056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8c88-18bb-49de-b67d-3ea927787cf3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:42.230484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:42.232694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:42.232694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:42.232694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:42.233018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:42.234670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:42.234670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318a4c-80ea-4f3c-bd31-c0cfa7a60868 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:42.248374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 528/1050] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:42.254173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:42.268894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:42.355026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e429-218d-4d6a-b261-6e9908b5b0ef None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:42.389645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:42.390305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:42.390590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:42.390869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:42.391690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] RBAC: Adding query filter params (role.id=0be01bc2abe3453a9f71b76b96d41c83, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:42.392007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:42.393458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf006-cae5-463c-a36d-e572e6ec2002 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:42.399133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 523/1051] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:42 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=0be01bc2abe3453a9f71b76b96d41c83 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:43.152488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356399e-e4e6-41d8-b7cf-dcfbad83a7b9 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.153036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356399e-e4e6-41d8-b7cf-dcfbad83a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.153148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356399e-e4e6-41d8-b7cf-dcfbad83a7b9 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.154456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 529/1052] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:43.160765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.161219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.161370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.180504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:43.181745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:43.257188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 524/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:43.280719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356399e-e4e6-41d8-b7cf-dcfbad83a7b9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:43.378449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:43.383659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356399e-e4e6-41d8-b7cf-dcfbad83a7b9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:43.416759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:43.417486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.417773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.418053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.429313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:43.436960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:43.437959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:43.438853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:43.440203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 530/1054] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:43.444172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:43.452351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:43.564866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307061a-cd51-4f76-9e0d-5233855257b5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:43.603483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:43.604156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.604439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.604738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.605479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:43.605785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:43.607167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:43.620904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 525/1055] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:43.622466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:43.725622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309632-12db-44f9-a10e-02ec8afe836e None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:43.759457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:43.760323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.760616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.760971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] PATH_INFO: `/v3/users/bfd42704e67943daa0dffb129127f520` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.774530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] RBAC: Authorizing `identity:get_user(user_id=bfd42704e67943daa0dffb129127f520)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:43.775966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:43.777879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 531/1056] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:43 2022] GET /identity/v3/users/bfd42704e67943daa0dffb129127f520 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:43.783276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:43.851325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:43.887476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3e1a-dd53-4fa3-8240-8ab9d418e44c None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:43.922647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:43.923308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:43.923601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:43.923903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:43.992316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:43.993718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6016-cfa2-4d9a-90c0-8a66db9905b0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:44.062658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.102868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 526/1057] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:44.104652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.123807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.213442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a58280-ad19-4ed7-99ed-4449b64e3c33 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:44.223050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf96b-2fc2-4746-bc65-c6d480b50566 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.223512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf96b-2fc2-4746-bc65-c6d480b50566 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.223613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf96b-2fc2-4746-bc65-c6d480b50566 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.225762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 527/1058] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:44.230779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.230779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.231080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.248791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:44.249977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:44.257586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:44.258458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.258751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.259030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.260217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:44.261690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:44.263386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 532/1059] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:44.269783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.326917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 528/1060] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:44.350467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.363419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.383486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49cf4d-7e4e-4650-aa04-68546977b719 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:44.423621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:44.424573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.425118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.425393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.426233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=7c5a770d75a04653a6c3f552aad92fb6, user.id=bfd42704e67943daa0dffb129127f520) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:44.426550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:44.428022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b7d6-81a5-465d-bcb9-e28e6e2e6010 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:44.444653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 533/1061] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/role_assignments?user.id=bfd42704e67943daa0dffb129127f520&scope.project.id=7c5a770d75a04653a6c3f552aad92fb6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:44.457287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.462294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce48e-3232-4c5f-a895-3b7e65a1e70a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:44.501108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:44.501711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.501999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.502280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.579053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:44.580549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:44.637188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139fbe-9bce-42d7-a360-4409be008ca7 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.637533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139fbe-9bce-42d7-a360-4409be008ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.637759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139fbe-9bce-42d7-a360-4409be008ca7 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.639484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 534/1062] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:44.644424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.645164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.645457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.667785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:44.669460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:44.687800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.693520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 529/1063] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:40:44.699907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.749063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 535/1064] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:44.781080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.811005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9dda-263b-4365-a90c-e4ec1859ac83 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:44.850420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:44.851223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.851506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.851785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.862634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:44.864092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:44.869200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.891782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570dd8d-9cbe-4946-b37e-59494b5fffbc None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:44.897568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:44.898559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 530/1065] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:44.906359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:44.933488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:44.934676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:44.935166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:44.935597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:44.946274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:44.954730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:44.955877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:44.956950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:44.960099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 536/1066] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:44.964340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:44.965664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.017935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626935e-fad9-407f-94b1-9812251412f4 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.056551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.057460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.057754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.058044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.058765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:45.059083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.060920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.071646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03658-351b-4d3e-8620-b55d3e2bf524 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.072916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 531/1067] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:45.113920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.115203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.115500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.115766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.116537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:45.116884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.118274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.124776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:45.128452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 537/1068] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:45.134961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.276847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610af1-b26d-43fb-aac5-b2cbacec7478 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.290323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:45.314834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.315558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.315848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.316129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.328312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.329797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:45.346816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:45.347759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:45.348856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:45.348856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:45.348856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:45.348856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:45.348856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 532/1069] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:45.354372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.459493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd4ff-500c-4e03-aba4-12e89c85637f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.492448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.493135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.493424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.493699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.494420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:45.494728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.496084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.507611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 538/1070] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:45.513155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.616449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779485-9736-4836-975d-650e7fc0c56a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.649217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.650005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.650295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.650573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.658019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.659477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:45.673974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:45.674970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:45.675974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 533/1071] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:45.681871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.743581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:45.784002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f843-e55b-4bef-8a11-0470baa0785c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.816923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.817585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.818014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.818296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.819121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:45.819427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.820862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.837793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 539/1072] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:45.843389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.868330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:45.942381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f116482-1e91-4506-9851-2e516d4c137d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.979781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.980568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.980877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.981155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.990803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.992235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:46.009944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:46.010862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:46.011762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:46.011762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:46.011762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:46.011762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:46.011762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 534/1073] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:46.016908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:46.113350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a9a2-30f1-455c-af61-1f4c1c35bec0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:46.130771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:46.148397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:46.149085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.149371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.149647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.150362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:46.150676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:46.152024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:46.163672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 540/1074] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:46.169508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:46.244259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:46.269427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562b10e-0cd5-4393-b258-7fcdfd750322 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:46.305081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:46.305871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.306154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.306430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.312930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:46.314358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:46.328233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:46.329197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:46.330119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 535/1075] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:46.335350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:46.434801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c8d9a-39ec-4080-89b7-48a414915396 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:46.467477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:46.468125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.468405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.468706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.469487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:46.469799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:46.471220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34e5f-1edd-46ca-8a33-ed9a706a4287 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:46.484145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 541/1076] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:46.490361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:46.592704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4512d-c988-4803-a361-77f078b80db2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:46.627032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:46.627919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.628200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.628476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/0be01bc2abe3453a9f71b76b96d41c83` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.631303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=c0b8fde7b5024cf5b39899fae30a463e, role_id=0be01bc2abe3453a9f71b76b96d41c83)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:46.632879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:46.635043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:46.701412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038d73-1c90-4b0b-9e82-e16a88014e85 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.701609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038d73-1c90-4b0b-9e82-e16a88014e85 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.701928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038d73-1c90-4b0b-9e82-e16a88014e85 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.703297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 542/1077] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:46.707485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 536/1078] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:46 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/c0b8fde7b5024cf5b39899fae30a463e/roles/0be01bc2abe3453a9f71b76b96d41c83 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:40:46.708468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.708794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.709133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.728213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:46.729477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:46.762577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:46.808671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 543/1079] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:46.832239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:46.939751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad698c-cee7-4195-ba82-93d941a5bd55 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:46.972683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:46.973400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:46.973688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:46.974502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:46.984824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:46.993426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:46.994421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:46.995298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 537/1080] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:47.002174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:47.101352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682d01-fad8-46f3-8f27-debcaef88a94 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:47.136373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:47.137064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:47.137352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:47.137631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:47.138376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:47.138686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:47.140048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:47.148098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 544/1081] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:47.153882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:47.209869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:47.257678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86e186-d9e3-4b73-814a-34ba4b1317ea None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:47.294085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:47.294958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:47.295241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:47.295516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] PATH_INFO: `/v3/users/bfd42704e67943daa0dffb129127f520` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:47.296717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] RBAC: Authorizing `identity:get_user(user_id=bfd42704e67943daa0dffb129127f520)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:47.298160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:47.299789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 538/1082] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:47 2022] GET /identity/v3/users/bfd42704e67943daa0dffb129127f520 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:47.306281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:47.337295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:47.407808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a187-7e88-4b01-a3cf-360bb1c8e627 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:47.440194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:47.441229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:47.441510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:47.441784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:47.443539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:47.444985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce451-184d-4b52-81c4-69a7a4c83889 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:47.446652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 545/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:40:47 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:47.452479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:47.550954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed849f-e9e7-498d-9277-a88947518573 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:47.572561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:47.584144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:47.585197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:47.585486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:47.585763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6/users/bfd42704e67943daa0dffb129127f520/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:47.587708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5a770d75a04653a6c3f552aad92fb6, user_id=bfd42704e67943daa0dffb129127f520, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:47.589173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4d821-8ed3-49b7-be5f-93940c585553 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:47.709904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 539/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:40:47 2022] PUT /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6/users/bfd42704e67943daa0dffb129127f520/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:40:49.032842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e849-8197-43d0-9c28-a8a5791aeb41 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.033409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e849-8197-43d0-9c28-a8a5791aeb41 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.033409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e849-8197-43d0-9c28-a8a5791aeb41 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.034752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 546/1085] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:49.042244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.042892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.043033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.062840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:49.064031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:49.142332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 540/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:49.166587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8e849-8197-43d0-9c28-a8a5791aeb41 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.267733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:49.272647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8e849-8197-43d0-9c28-a8a5791aeb41 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.305869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.306608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.306893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.307170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.317068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:49.325221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:49.326192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:49.327050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 547/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:49.332631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.431053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf901fc-b269-44a4-b587-90afc3606b6f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.444214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:49.465527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.466200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.466485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.466762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.467520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:49.467887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:49.469289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:49.477957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 541/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:49.483599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.581580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490546e-5c51-4e86-82c8-525c9a0ac30a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.614479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.615393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.615673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.615946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.626403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:49.627955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:49.646237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:49.647633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:49.648754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:49.648754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:49.648754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:49.648754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:49.648754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 548/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:49.653253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.753653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e5bf-cea6-480f-aad6-2136f64e112f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.787960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.788640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.789192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.789478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.790201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:49.790515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:49.791886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:49.804311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 542/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:49.809893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.823316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:49.916829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0869-c330-4842-8b2a-a0beb04a09e2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.956909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.957700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.957988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.958331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.966212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:49.967645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-40930c52-c36c-46a0-9d5a-6d94745d4165 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:40:49.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:49.983453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:49.984449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 549/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:40:49.989262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.037342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.098503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce262f3-463b-415f-b359-13f65d8ba1b5 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.099683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce262f3-463b-415f-b359-13f65d8ba1b5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.099683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce262f3-463b-415f-b359-13f65d8ba1b5 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.101101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 550/1092] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:50.105738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d54ca-2dfb-4606-9fb2-fd0621515e42 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.106145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.106331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.106612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.123057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:50.124239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:50.140544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.141243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.141528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.141809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.142639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:50.142948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.144364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.163185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 543/1093] 10.222.0.57 () {56 vars in 1133 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:50.169168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.187820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.192432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 551/1094] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:40:50.216788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.262544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.271821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a85de-6661-46fd-a3e6-9c8a2ea15379 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.306374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.307031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.307325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.307609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.318956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa334c9b-d55c-4743-96e5-063962a78740 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.353114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.353907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.354207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.354491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.364838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:40:50.372370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:50.373413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:40:50.374308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 552/1095] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:50.375167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.376577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.379544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.436627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.464923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.474685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 544/1096] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:40:50.479943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07283de-0396-4a81-b972-997f20f889e4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.480442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.513716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.514393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.514682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.514960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.515733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:50.516043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.517447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.525835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 553/1097] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:50.531601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.578753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029e6a-45a2-4447-9fa0-d62d434ff8f5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.612022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.612841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.613132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.613413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.623299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.624825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.632224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1bf75-0d99-4b8f-815a-a237d8d929a9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:40:50.642466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:50.643394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:50.644305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:40:50.644305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:40:50.644305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:40:50.644305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:50.644305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 545/1098] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:50.649416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.654875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.667213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.668135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.668418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.668716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] PATH_INFO: `/v3/users/bfd42704e67943daa0dffb129127f520` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.669907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] RBAC: Authorizing `identity:get_user(user_id=bfd42704e67943daa0dffb129127f520)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.671332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.672985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 554/1099] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/users/bfd42704e67943daa0dffb129127f520 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:50.679223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.696124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.750560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b845-75a3-4071-ac6b-e9763efde2a0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.779950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001457ac-0b22-4b8b-b325-3c03f582b99f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.784569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.785268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.785553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.785831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.787205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:50.787628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.789298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.800344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 546/1100] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:50.806294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.813424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.814071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.814363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.814642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.874133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.885070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.886594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.903991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ffb4a-8960-49e7-aa3f-fcaa31fbe2e0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:50.909588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:50.938631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:50.939456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:50.939749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:50.940024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:50.947644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:50.949630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:40:50.963671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:40:50.964590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:40:50.965546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 547/1101] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:40:50.970710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:50.991062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 555/1102] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:40:50.996777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:51.073567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687faf-584d-4f7b-8515-3ea01ee97ff0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:51.088717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:51.097941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98ceb-aec2-4270-96f4-f77a9cf9509f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:51.109208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:51.109881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:51.110174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:51.110460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:51.111296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:51.111658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:51.113130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:51.125564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 548/1103] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:51.132370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:51.134154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:51.135021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:51.135309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:51.135589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:51.136797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:51.138215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:51.140958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 556/1104] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:40:50 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:51.146445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:51.158571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:51.238430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc983b8-a06d-4249-a2bb-5ee78d9e273f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:51.246217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03206c4-127d-4aa4-b73e-45aee098e3f0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:51.273532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:51.274190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:51.274478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:51.274760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:51.275584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] RBAC: Adding query filter params (role.id=0be01bc2abe3453a9f71b76b96d41c83, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=c0b8fde7b5024cf5b39899fae30a463e) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:51.275902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:51.277356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc653939-115c-4296-be8c-294f7fe07fd8 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:51.280381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:51.281063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:51.281352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:51.281635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:51.282460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=7c5a770d75a04653a6c3f552aad92fb6, user.id=bfd42704e67943daa0dffb129127f520) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:51.282777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:51.283243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 549/1105] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:51 2022] GET /identity/v3/role_assignments?user.id=c0b8fde7b5024cf5b39899fae30a463e&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=0be01bc2abe3453a9f71b76b96d41c83 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:51.284185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8455b70-cdbf-4331-96ca-4753d2b29f24 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:51.297886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 557/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:51 2022] GET /identity/v3/role_assignments?user.id=bfd42704e67943daa0dffb129127f520&scope.project.id=7c5a770d75a04653a6c3f552aad92fb6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:53.515083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380014a-6461-40b5-953f-bac51fef6515 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.515599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380014a-6461-40b5-953f-bac51fef6515 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.515599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380014a-6461-40b5-953f-bac51fef6515 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.517044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 550/1107] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:53.523256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.523653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.523820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.540601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:53.541799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:53.557660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:53.605701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 558/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:53.630519 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380014a-6461-40b5-953f-bac51fef6515 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:53.717268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:53.729697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380014a-6461-40b5-953f-bac51fef6515 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:53.763013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:53.763791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.764076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.764350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.765588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:53.766972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783f778-1ee0-4cac-b0a6-09cf44b60c5f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:53.768564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 551/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:53.775145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:53.871367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4491d-092c-4580-a5d3-4f63f034a9e8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:53.904480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:53.905174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.905463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.905741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.906453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:53.907937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b850-503c-418f-9fe9-092c56f24698 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:53.995512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 559/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:40:53 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:40:56.273571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743cc8-4fb5-449a-adf3-b143c0f77d53 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.274033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743cc8-4fb5-449a-adf3-b143c0f77d53 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.274140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743cc8-4fb5-449a-adf3-b143c0f77d53 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.275513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 552/1111] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:56.280744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.281191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.281317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.299546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:56.300764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:56.302928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:56.368896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 560/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:56.392744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6743cc8-4fb5-449a-adf3-b143c0f77d53 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:56.491425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6743cc8-4fb5-449a-adf3-b143c0f77d53 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:56.524555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:56.525420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.525705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.525980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] PATH_INFO: `/v3/roles/7513e8315142426297257e9970c65752` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.527433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] RBAC: Authorizing `identity:get_role(role_id=7513e8315142426297257e9970c65752)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:56.528816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:56.530192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 553/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:56 2022] GET /identity/v3/roles/7513e8315142426297257e9970c65752 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:56.535898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:56.632880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440346d-6323-4672-a5e1-08de06257dbf None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:56.666100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:56.666954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.667242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.667522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] PATH_INFO: `/v3/users/57b656e8809443ee8fcfb270560c0790` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.674546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:56.680450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] RBAC: Authorizing `identity:get_user(user_id=57b656e8809443ee8fcfb270560c0790)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:56.689511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:56.689511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 561/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:56 2022] GET /identity/v3/users/57b656e8809443ee8fcfb270560c0790 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:56.689702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:56.715859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:56.788362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466abfe-da6a-4698-abab-c7cad9dcc68b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:56.821748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:56.822388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.822676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.822957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.887732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:56.889215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:56.911897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:56.983819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 554/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:40:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:40:56.990358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:57.088324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e10062-a24a-4c1d-8c04-7f5822522cff None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:57.120791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:57.121637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:57.121925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:57.122201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:57.123369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:57.124817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f1c89-0e00-462d-808d-3488df4e3c26 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:57.126486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 562/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:40:56 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:57.133665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:57.228368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6d0e-a85e-4b6b-b2b6-6c5f02090ded None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:57.251318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:57.261492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:57.262141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:57.262425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:57.262702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:57.263517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=7c5a770d75a04653a6c3f552aad92fb6, user.id=57b656e8809443ee8fcfb270560c0790) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:40:57.263828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:57.265345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3521d-14e6-4732-abb5-48d1db6f32dd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:57.270792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 555/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:40:57 2022] GET /identity/v3/role_assignments?user.id=57b656e8809443ee8fcfb270560c0790&scope.project.id=7c5a770d75a04653a6c3f552aad92fb6&role.id=7513e8315142426297257e9970c65752 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:40:59.473886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a13f-cfcf-469b-b9f2-7ea244541e7a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.474437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a13f-cfcf-469b-b9f2-7ea244541e7a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.474437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a13f-cfcf-469b-b9f2-7ea244541e7a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.475823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 563/1118] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:59.481205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.481630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.481765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.498054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:59.499157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:59.563303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 556/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:40:59.587157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24a13f-cfcf-469b-b9f2-7ea244541e7a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:59.648803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:59.684779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24a13f-cfcf-469b-b9f2-7ea244541e7a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:59.718572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:59.719414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.719700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.719976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] PATH_INFO: `/v3/roles/7513e8315142426297257e9970c65752` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.721464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] RBAC: Authorizing `identity:get_role(role_id=7513e8315142426297257e9970c65752)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:59.722820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:59.724177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 564/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:59 2022] GET /identity/v3/roles/7513e8315142426297257e9970c65752 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:59.729904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:59.828018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cbe0f-cc9f-429c-b89d-22c1559ae682 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:59.845626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:59.862005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:59.862906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.863190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.863473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] PATH_INFO: `/v3/users/57b656e8809443ee8fcfb270560c0790` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.865519 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] RBAC: Authorizing `identity:get_user(user_id=57b656e8809443ee8fcfb270560c0790)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:59.866999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:59.868696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 557/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:40:59 2022] GET /identity/v3/users/57b656e8809443ee8fcfb270560c0790 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:59.874641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:59.970863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18fd9-e878-4d0f-9c6f-efb4ab5efed9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:59.999477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:00.004148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:00.005724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:00.006013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:00.010078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:00.010078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:00.010078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9ad5-bef5-4a68-bca8-1f7328bd7b96 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:00.010561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 565/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:40:59 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:00.016508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:00.123514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c303-7e32-4ef2-8b69-fc557c449030 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:00.158391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:00.159276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:00.159563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:00.159844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6/users/57b656e8809443ee8fcfb270560c0790/roles/7513e8315142426297257e9970c65752` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:00.162900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c5a770d75a04653a6c3f552aad92fb6, user_id=57b656e8809443ee8fcfb270560c0790, role_id=7513e8315142426297257e9970c65752)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:00.164591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e39f-2bfb-4387-af99-0d297efc6dc3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:00.234936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 558/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:41:00 2022] PUT /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6/users/57b656e8809443ee8fcfb270560c0790/roles/7513e8315142426297257e9970c65752 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:02.433704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71f4-fbfa-43df-8126-ce208f9aa238 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.434290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71f4-fbfa-43df-8126-ce208f9aa238 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.434290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71f4-fbfa-43df-8126-ce208f9aa238 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.435633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 566/1124] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:02.440854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.441277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.441436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.460701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:02.461883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:02.507302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:02.531026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 559/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:02.555862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c71f4-fbfa-43df-8126-ce208f9aa238 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:02.656634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c71f4-fbfa-43df-8126-ce208f9aa238 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:02.690465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:02.691337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.691623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.691934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] PATH_INFO: `/v3/roles/7513e8315142426297257e9970c65752` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.693514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] RBAC: Authorizing `identity:get_role(role_id=7513e8315142426297257e9970c65752)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:02.694880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:02.696231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 567/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:02 2022] GET /identity/v3/roles/7513e8315142426297257e9970c65752 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:02.702029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:02.799886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9835b0-ee92-402d-a52a-d169107a12a5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:02.831738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:02.833204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.833437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.833790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] PATH_INFO: `/v3/users/57b656e8809443ee8fcfb270560c0790` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.834967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] RBAC: Authorizing `identity:get_user(user_id=57b656e8809443ee8fcfb270560c0790)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:02.836382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:02.838006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 560/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:02 2022] GET /identity/v3/users/57b656e8809443ee8fcfb270560c0790 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:02.844651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:02.909697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:02.941654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27698a93-8730-4451-bac8-93468d9faa51 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:02.974714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:02.975341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.975624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.975898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:03.040131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:03.041584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:03.103322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:03.136021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 568/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:03.141581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:03.187153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:03.239914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18468-f22c-4dce-9ebc-6a48e0d7881d None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:03.273742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:03.274591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:03.274873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:03.275146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] PATH_INFO: `/v3/projects/7c5a770d75a04653a6c3f552aad92fb6` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:03.276293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] RBAC: Authorizing `identity:get_project(project_id=7c5a770d75a04653a6c3f552aad92fb6)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:03.277741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfcd01-d757-476d-b453-5e7429953872 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:03.279412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 561/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:03 2022] GET /identity/v3/projects/7c5a770d75a04653a6c3f552aad92fb6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:03.285456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:03.381928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5ff0-42fc-4298-9773-2db36efbdbb4 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:03.416495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:03.417175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:03.417466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:03.417747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:03.418583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] RBAC: Adding query filter params (role.id=7513e8315142426297257e9970c65752, scope.project.id=7c5a770d75a04653a6c3f552aad92fb6, user.id=57b656e8809443ee8fcfb270560c0790) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:03.418901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:03.420331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01c32b-05db-48ed-a7e7-153f4081963c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:03.426036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 569/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:41:03 2022] GET /identity/v3/role_assignments?user.id=57b656e8809443ee8fcfb270560c0790&scope.project.id=7c5a770d75a04653a6c3f552aad92fb6&role.id=7513e8315142426297257e9970c65752 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:05.671857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94b4b-bfa6-4424-a984-52669d6284dc None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:05.672382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94b4b-bfa6-4424-a984-52669d6284dc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:05.672476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94b4b-bfa6-4424-a984-52669d6284dc None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:05.673798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 562/1131] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:05.679437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:05.679899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:05.679992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:05.696981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:05.698173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:05.723930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:05.763297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 570/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:41:05.787068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab94b4b-bfa6-4424-a984-52669d6284dc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:05.884494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab94b4b-bfa6-4424-a984-52669d6284dc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:05.897160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:05.916635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:05.917410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:05.917692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:05.917968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:05.919123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:05.920542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bbf1-af70-4c10-93bb-13a6684e7511 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:05.922199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 563/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:05.928398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:06.024502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733b658-cc46-4f28-a23e-f5fc70bacf86 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:06.058281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:06.058931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:06.059221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:06.059501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:06.060197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:06.061653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6289a90-a014-4b3a-b521-86cfd6e97618 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:06.176532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 571/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:41:05 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:08.391786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d019-b354-4d18-b408-e61fe466936c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:08.392320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d019-b354-4d18-b408-e61fe466936c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:08.392421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d019-b354-4d18-b408-e61fe466936c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:08.393761 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 564/1135] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:08.399640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:08.400045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:08.400197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:08.417038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:08.418221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:08.427342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:08.484958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 572/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:41:08.509109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8d019-b354-4d18-b408-e61fe466936c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:08.606373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8d019-b354-4d18-b408-e61fe466936c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:08.640765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:08.641542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:08.641824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:08.642099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:08.643242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:08.644704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d8ff8-f644-4cbf-b8d8-9a5ee6a57ecd None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:08.646877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 565/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:08.652462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:08.748484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da33787-c8d1-417b-93be-a95c46e32ff1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:08.782434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:08.783035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:08.783321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:08.783599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:08.784309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:08.785871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e0a0-d89f-4019-be75-3a12cea79822 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:08.887224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:08.892078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 573/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:41:08 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:41:11.150482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51acd-dccd-4ce0-a67e-d87e0ed8bad2 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.151021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51acd-dccd-4ce0-a67e-d87e0ed8bad2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.151021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51acd-dccd-4ce0-a67e-d87e0ed8bad2 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.152408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 566/1139] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:11.157670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.158064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.158222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.175564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:11.176914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:11.243234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 574/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:11.266306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e51acd-dccd-4ce0-a67e-d87e0ed8bad2 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:11.316639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:11.366794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e51acd-dccd-4ce0-a67e-d87e0ed8bad2 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:11.400152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:11.401005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.401249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.401527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.411200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:11.419007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:11.420116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:11.421053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 567/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:11.426588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:11.522193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a9b8-b090-4776-a90c-ff0859fe4143 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:11.549421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:11.555153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:11.555821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.556105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.556382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.557156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:11.557467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:11.558822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:11.567203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 575/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:11.573078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:11.674336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7a67-218c-45c6-9938-21fc2f024ab8 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:11.682729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:11.706659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:11.708071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.708352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.708648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] PATH_INFO: `/v3/users/345eda7479b2402298264325aab83466` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.721949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] RBAC: Authorizing `identity:get_user(user_id=345eda7479b2402298264325aab83466)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:11.723429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:11.725103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 568/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:11 2022] GET /identity/v3/users/345eda7479b2402298264325aab83466 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:11.730863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:11.827136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab9c9-9bd7-4a79-abaf-055ad5d52748 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:11.860862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:11.861507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:11.861789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:11.862062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:11.921910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:11.930797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:11.932172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:12.025717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 576/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:12.031597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:12.127007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00b58-ab01-45c4-b8f0-218a298bde0a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:12.160106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:12.161016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:12.161301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:12.161578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] PATH_INFO: `/v3/projects/d8c4383efc50487384c2a5ad34618063` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:12.162740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c4383efc50487384c2a5ad34618063)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:12.164410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ccea6-b077-4c68-84d3-dcd5a91ba981 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:12.166090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 569/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:12 2022] GET /identity/v3/projects/d8c4383efc50487384c2a5ad34618063 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:12.172201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:12.263268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:12.272349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4986-1a35-4ae6-983b-1e5040f411b9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:12.306733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:12.307382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:12.307668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:12.307947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:12.308799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=d8c4383efc50487384c2a5ad34618063, user.id=345eda7479b2402298264325aab83466) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:12.309116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:12.310533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db16f0-ed11-49e8-8568-9358bbdd51b4 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:12.315861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 577/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:41:12 2022] GET /identity/v3/role_assignments?user.id=345eda7479b2402298264325aab83466&scope.project.id=d8c4383efc50487384c2a5ad34618063&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:14.500324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca353-23d0-48fa-b8e5-2279872a5d30 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:14.500856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca353-23d0-48fa-b8e5-2279872a5d30 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:14.500856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca353-23d0-48fa-b8e5-2279872a5d30 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:14.502208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 570/1147] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:14.507969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:14.508351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:14.508526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:14.525699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:14.526873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:14.599920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 578/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:14.622641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afca353-23d0-48fa-b8e5-2279872a5d30 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:14.657928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:14.723031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afca353-23d0-48fa-b8e5-2279872a5d30 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:14.756074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:14.756815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:14.757108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:14.757388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:14.767094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:14.775426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:14.776528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:14.777629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 571/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:14.782662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:14.872936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:14.889088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ca34-708a-47fc-8eda-de994b7f08ae None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:14.921882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:14.922537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:14.922819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:14.923091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:14.923832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:14.924137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:14.925510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:14.933880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 579/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:14.939766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:15.036699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:15.043217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce70a4-2092-4856-9a57-0f6ec02756af None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:15.078416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:15.079275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:15.079557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:15.079827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] PATH_INFO: `/v3/users/345eda7479b2402298264325aab83466` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:15.081021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] RBAC: Authorizing `identity:get_user(user_id=345eda7479b2402298264325aab83466)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:15.082569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:15.084169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 572/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:14 2022] GET /identity/v3/users/345eda7479b2402298264325aab83466 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:15.089833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:15.187032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a206f-5f6e-4b17-b543-30e418f92a57 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:15.218490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:15.219340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:15.219621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:15.219894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] PATH_INFO: `/v3/projects/d8c4383efc50487384c2a5ad34618063` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:15.221161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c4383efc50487384c2a5ad34618063)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:15.223096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196be4-95e0-4f71-ab93-c32bb8401c08 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:15.224984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 580/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:15 2022] GET /identity/v3/projects/d8c4383efc50487384c2a5ad34618063 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:15.230808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:15.328228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1554f-dd99-470e-bbe4-6728603957ee None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:15.361005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:15.361881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:15.362165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:15.362441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] PATH_INFO: `/v3/projects/d8c4383efc50487384c2a5ad34618063/users/345eda7479b2402298264325aab83466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:15.365067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=d8c4383efc50487384c2a5ad34618063, user_id=345eda7479b2402298264325aab83466, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:15.366497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2cf7-ecda-4f42-9aac-1776ee003d2f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:15.457126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 573/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:41:15 2022] PUT /identity/v3/projects/d8c4383efc50487384c2a5ad34618063/users/345eda7479b2402298264325aab83466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:17.675907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf066f-a4ab-433f-a786-9c3452fec889 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:17.676489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf066f-a4ab-433f-a786-9c3452fec889 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:17.676489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf066f-a4ab-433f-a786-9c3452fec889 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:17.677859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 581/1154] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:17.683044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:17.683449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:17.683603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:17.700250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:17.701461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:17.717800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:17.766431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 574/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:17.791610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf066f-a4ab-433f-a786-9c3452fec889 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:17.810765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:17.892921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf066f-a4ab-433f-a786-9c3452fec889 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:17.924711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:17.925491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:17.926386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:17.926654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:17.936831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:17.944976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:17.946182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:41:17.947410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 582/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:17.952292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:18.056330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba200-5969-43a3-9b18-633f810ea688 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:18.089134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:18.089793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:18.090085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:18.090375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:18.091122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:18.091437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:18.092833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:18.100677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 575/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:18.106498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:18.182596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:18.204259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2492e-2d23-4ae6-9fe8-fe385003bf0a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:18.240651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:18.241522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:18.241805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:18.242081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] PATH_INFO: `/v3/users/345eda7479b2402298264325aab83466` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:18.243243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] RBAC: Authorizing `identity:get_user(user_id=345eda7479b2402298264325aab83466)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:18.244688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:18.246289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 583/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:18 2022] GET /identity/v3/users/345eda7479b2402298264325aab83466 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:18.252016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:18.268927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:18.351085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd952b6-6d81-4b7b-9cff-797a2d5c83e2 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:18.384087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:18.384762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:18.385051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:18.385328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:18.451972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:18.453393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:18.467563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:18.551046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 576/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:18.556964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:18.653869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34120-16a3-4a53-b0ad-2139246553b3 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:18.686863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:18.687706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:18.687991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:18.688270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] PATH_INFO: `/v3/projects/d8c4383efc50487384c2a5ad34618063` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:18.689458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c4383efc50487384c2a5ad34618063)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:18.690875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae84da-3988-44ab-b949-380b3cc61215 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:18.692583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 584/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:18 2022] GET /identity/v3/projects/d8c4383efc50487384c2a5ad34618063 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:18.698616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:18.797344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9c62-4d04-4e2f-a72d-67bf5222a8bb None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:18.810777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:18.830054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:18.830700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:18.830989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:18.831272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:18.832878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=d8c4383efc50487384c2a5ad34618063, user.id=345eda7479b2402298264325aab83466) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:18.833280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:18.834713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ba64-28ff-40cc-97b0-af2b1e823859 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:18.840493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 577/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:41:18 2022] GET /identity/v3/role_assignments?user.id=345eda7479b2402298264325aab83466&scope.project.id=d8c4383efc50487384c2a5ad34618063&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:21.075829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1fe2-69ec-43cd-a38b-b29187d75faa None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:21.076380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1fe2-69ec-43cd-a38b-b29187d75faa None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:21.076380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1fe2-69ec-43cd-a38b-b29187d75faa None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:21.077816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 585/1162] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:21.083608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:21.084036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:21.084185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:21.100945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:21.102154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:21.169045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 578/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:21.192115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1fe2-69ec-43cd-a38b-b29187d75faa None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:21.206428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:21.293796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1fe2-69ec-43cd-a38b-b29187d75faa None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:21.328602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:21.329330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:21.329620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:21.329904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:21.394954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:21.396392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:21.409266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:21.491668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 586/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:21.497673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:21.592499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7526-ba80-43c1-82f6-b067e0e5bf49 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:21.601234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:21.625037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:21.625939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:21.626494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:21.626773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:21.633800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:21.635228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-c666e053-9f71-4693-9006-58925c8a1b10 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:21.648873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:21.650690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:41:21.652306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:21.654865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 579/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:41:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:21.656108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:21.782830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795c32-817b-4c25-8b0b-0817fd12e21d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:21.802976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:21.824575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:21.825270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:21.825560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:21.825841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:21.826561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:21.826872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:21.828349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb34c-21ac-4977-ac7b-6269c9735ac1 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:21.835909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 587/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Wed May 25 14:41:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:24.003348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b26c8-d042-40c1-9780-f717d3ed83bc None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:24.004107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b26c8-d042-40c1-9780-f717d3ed83bc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:24.004107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b26c8-d042-40c1-9780-f717d3ed83bc None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:24.005918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 580/1167] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:24.011048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5940-7977-4c2b-9cb3-b1acd30da1c8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:24.011446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5940-7977-4c2b-9cb3-b1acd30da1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:24.011623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5940-7977-4c2b-9cb3-b1acd30da1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:24.028077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9dcc5940-7977-4c2b-9cb3-b1acd30da1c8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:24.029306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9dcc5940-7977-4c2b-9cb3-b1acd30da1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:24.095091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 588/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:24.118244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b26c8-d042-40c1-9780-f717d3ed83bc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:24.216886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b26c8-d042-40c1-9780-f717d3ed83bc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:24.250455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:24.251109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:24.251396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:24.251677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:24.252405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:24.254082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa41fc-c91f-4e33-ba7c-da5605cf7f74 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:24.329594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 581/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Wed May 25 14:41:24 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:26.552458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772801-7711-4d86-ae31-d96628d186c1 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:26.553001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772801-7711-4d86-ae31-d96628d186c1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:26.553001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772801-7711-4d86-ae31-d96628d186c1 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:26.554385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 589/1170] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:26.559591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:26.559975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:26.560162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:26.576489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:26.577702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:26.599915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:26.641335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 582/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:26.665294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772801-7711-4d86-ae31-d96628d186c1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:26.764594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772801-7711-4d86-ae31-d96628d186c1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:26.772204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:26.798140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:26.798987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:26.799274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:26.799554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] PATH_INFO: `/v3/domains/32385c5556044cc18e9365107aa57da3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:26.810394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32385c5556044cc18e9365107aa57da3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:26.811776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca987-193d-45c0-b253-089d52263278 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:26.813402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 590/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Wed May 25 14:41:26 2022] GET /identity/v3/domains/32385c5556044cc18e9365107aa57da3 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:26.819785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:26.914625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2442e0-4880-4189-af3f-be57836b8bbb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:26.948527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:26.949235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:26.949521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:26.949800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:26.950496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:26.951950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b884f85-f383-42df-8937-0f128b603907 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:27.021802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 583/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:41:26 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:29.266351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166d80-a0d5-4cda-9bac-3674a371abd7 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:29.266845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166d80-a0d5-4cda-9bac-3674a371abd7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:29.266943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166d80-a0d5-4cda-9bac-3674a371abd7 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:29.268264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 591/1174] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:29.273975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:29.274394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:29.274550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:29.292003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:29.293225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:29.295894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:29.357526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 584/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:29.382775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166d80-a0d5-4cda-9bac-3674a371abd7 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:29.487208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166d80-a0d5-4cda-9bac-3674a371abd7 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:29.519581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:29.520434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:29.520890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:29.521176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] PATH_INFO: `/v3/domains/32385c5556044cc18e9365107aa57da3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:29.522352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32385c5556044cc18e9365107aa57da3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:29.523782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f56f-a3a9-4f22-8e94-2d1ea3bbb5e3 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:29.525413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 592/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Wed May 25 14:41:29 2022] GET /identity/v3/domains/32385c5556044cc18e9365107aa57da3 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:29.531115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:29.625558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e2b5a-c671-426d-8475-7dbaa9227e96 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:29.657574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:29.658230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:29.658513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:29.658786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:29.660060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:29.661530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54896d56-dec6-4d49-a3c3-fa2d56e9b31b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:29.671000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:29.751095 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 585/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:41:29 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:32.044239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d9c5-8ba8-4284-9974-dc698c076483 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.044834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d9c5-8ba8-4284-9974-dc698c076483 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.044834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d9c5-8ba8-4284-9974-dc698c076483 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.046191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 593/1178] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:32.051505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.051900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.052060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.068954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:32.070144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:32.134734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 586/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:41:32.159060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953d9c5-8ba8-4284-9974-dc698c076483 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:32.195429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:32.261592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953d9c5-8ba8-4284-9974-dc698c076483 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:32.295930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:32.296674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.296965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.297243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.309103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:32.318314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:32.319459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:41:32.320511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 594/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:32.325709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:32.424508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100ee3-bf00-4181-ba2f-c09827b97950 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:32.451653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:32.460740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:32.468659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:32.472428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 587/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:32.478235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:32.568227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:32.574689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6bab-89a8-48bb-8028-7b84df024664 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:32.608488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:32.609386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.609681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.609963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] PATH_INFO: `/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.622369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] RBAC: Authorizing `identity:get_user(user_id=b47638cfaf8e4491b06e7e7c8fe3d3b8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:32.623811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:32.625480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 595/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:32 2022] GET /identity/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:32.631766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:32.731628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88831d-40d1-4a9e-af4d-4a9d9a61363b None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:32.765642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:32.766286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:32.766575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:32.766865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:32.823326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:32.835515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:32.837000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:32.934595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 588/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:32.940395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.039971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf233-95a4-4f54-a46e-e48cf08a173f None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.073158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.074065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.074302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.074581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] PATH_INFO: `/v3/projects/aec343704f724e1d8ae795825eafb21a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.075756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] RBAC: Authorizing `identity:get_project(project_id=aec343704f724e1d8ae795825eafb21a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.077207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443adba8-b042-41b3-b17c-7ba1817c3650 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:33.078856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 596/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:32 2022] GET /identity/v3/projects/aec343704f724e1d8ae795825eafb21a => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:33.085391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.171630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:33.183035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39411-513a-442c-be2d-365a70ad72ce None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.216527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.217207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.217494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.217772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.218593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=aec343704f724e1d8ae795825eafb21a, user.id=b47638cfaf8e4491b06e7e7c8fe3d3b8) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:33.218908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.220343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d146e6-542c-4fa8-b884-2bbbeb57e291 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:33.225887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 589/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:41:33 2022] GET /identity/v3/role_assignments?user.id=b47638cfaf8e4491b06e7e7c8fe3d3b8&scope.project.id=aec343704f724e1d8ae795825eafb21a&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:35.432590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6fd3-19c7-49fd-bdf5-4ac281426582 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.433151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6fd3-19c7-49fd-bdf5-4ac281426582 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.433268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6fd3-19c7-49fd-bdf5-4ac281426582 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.434539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 597/1186] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:35.439798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.440219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.440358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.457772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:35.458944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:35.523846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 590/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:35.545691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6fd3-19c7-49fd-bdf5-4ac281426582 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.568761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.649706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6fd3-19c7-49fd-bdf5-4ac281426582 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.682930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.683700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.683986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.684262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.695520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:35.703104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:35.704187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:41:35.705167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 598/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:35.710795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.789144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.806873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd2ada-0cff-49e8-9dfb-9091ad277f80 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.840152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.840838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.841129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.841410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.842152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:35.842462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.843824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.851939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 591/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:35.857912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.936189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.955185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8afa5-baec-45ae-85f2-894107ecbd0d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.987742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.988635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.988924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.989202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] PATH_INFO: `/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.990378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] RBAC: Authorizing `identity:get_user(user_id=b47638cfaf8e4491b06e7e7c8fe3d3b8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.991802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.993425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 599/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:35.999111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.098980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360db8-ca55-436a-b4fb-cc3b1bf0fb75 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.132648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.133504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.133797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.134080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] PATH_INFO: `/v3/projects/aec343704f724e1d8ae795825eafb21a` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.135246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] RBAC: Authorizing `identity:get_project(project_id=aec343704f724e1d8ae795825eafb21a)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.136712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b1469-940b-40a2-9753-42fa284e6f0b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.138388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 592/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/projects/aec343704f724e1d8ae795825eafb21a => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:36.145595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.247326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794505-8431-4499-9ddb-aed56c8a4708 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.279312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.280181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.280459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.280760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] PATH_INFO: `/v3/projects/aec343704f724e1d8ae795825eafb21a/users/b47638cfaf8e4491b06e7e7c8fe3d3b8/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.282663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] RBAC: Authorizing `identity:create_grant(project_id=aec343704f724e1d8ae795825eafb21a, user_id=b47638cfaf8e4491b06e7e7c8fe3d3b8, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.284075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c924-5d01-4f21-bdf2-38ed735b1de5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.366041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 600/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:41:36 2022] PUT /identity/v3/projects/aec343704f724e1d8ae795825eafb21a/users/b47638cfaf8e4491b06e7e7c8fe3d3b8/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:38.546930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ebc6-04a2-4a34-9c04-af5409197c47 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.547435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ebc6-04a2-4a34-9c04-af5409197c47 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.547435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ebc6-04a2-4a34-9c04-af5409197c47 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.548811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 593/1193] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:38.554889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.555332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.555517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.572097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:38.573317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:38.575257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:38.638195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 601/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:41:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:41:38.663038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6ebc6-04a2-4a34-9c04-af5409197c47 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.678862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:38.762621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6ebc6-04a2-4a34-9c04-af5409197c47 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.797212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.797931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.798219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.798500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.808433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:38.816264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:38.817408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:41:38.818468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 594/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:38.823427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.922542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00e2d-42bf-4f7d-bce3-dd7b8cc27833 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.955253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.956441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.956895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.957179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.957920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:38.958228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:38.959583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:38.964397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:38.967632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 602/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:38.973881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:39.043840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:39.072877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f636-160b-4665-8232-b37424f3311e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:39.106145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:39.107002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:39.107288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:39.107565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] PATH_INFO: `/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:39.108765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] RBAC: Authorizing `identity:get_user(user_id=b47638cfaf8e4491b06e7e7c8fe3d3b8)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:39.110188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:39.111794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 595/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/users/b47638cfaf8e4491b06e7e7c8fe3d3b8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:39.117939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:39.216586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaff09-c46d-48be-9f6d-051c8acc9d13 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:39.248459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:39.249130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:39.249412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:39.249686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:39.312460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:39.314622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:39.316753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:39.410068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 603/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:41:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:41:39.416175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:39.513327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcffc8a-28ea-41a8-b39d-7403be0c1606 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:39.545688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:39.546554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:39.546844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:39.547126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] PATH_INFO: `/v3/projects/aec343704f724e1d8ae795825eafb21a` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:39.548310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] RBAC: Authorizing `identity:get_project(project_id=aec343704f724e1d8ae795825eafb21a)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:39.550775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae7233-c38d-4fdc-b986-631ce31cb56d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:39.552466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 596/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Wed May 25 14:41:39 2022] GET /identity/v3/projects/aec343704f724e1d8ae795825eafb21a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:39.558530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:39.654240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:39.657066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abafe-d84a-4dfd-a652-332590b838c5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:39.691632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:39.692211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:39.692500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:39.692811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:39.693685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=aec343704f724e1d8ae795825eafb21a, user.id=b47638cfaf8e4491b06e7e7c8fe3d3b8) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:39.693984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:39.695402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dca22-eccb-404d-a001-34851584d0d0 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:39.701147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 604/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:41:39 2022] GET /identity/v3/role_assignments?user.id=b47638cfaf8e4491b06e7e7c8fe3d3b8&scope.project.id=aec343704f724e1d8ae795825eafb21a&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:49.541579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:49.698515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=18 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.711137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef01b4-c04c-4e4e-bcc4-3b00fbf14c27 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.711798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef01b4-c04c-4e4e-bcc4-3b00fbf14c27 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.711798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef01b4-c04c-4e4e-bcc4-3b00fbf14c27 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.713185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 597/1201] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:56.718267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.718723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.718828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.736291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:56.737554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:56.804886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 605/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:42:56.829583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef01b4-c04c-4e4e-bcc4-3b00fbf14c27 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.933539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef01b4-c04c-4e4e-bcc4-3b00fbf14c27 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.968540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.969292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.969579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.969856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.980255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.985756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:56.998942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:57.000110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:57.001211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:57.001211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:57.001211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:57.001211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:42:57.001211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 598/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:57.007155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.109772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01993363-a4f1-472b-a3f3-22d46c3966a5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.138178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:57.143958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.144650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.144943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.145234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.145961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:57.146276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.147645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe0e6f-fcc9-46af-a9ae-93c29d6bca17 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.158817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 606/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:57.164951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.218861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:57.265949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836d4f-1cc7-42d9-9b10-be578d156c02 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.301105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.301846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.302141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.302422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.303125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.304693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008869b9-74f3-4dcc-ad73-f883166fa2a1 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.400256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 599/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Wed May 25 14:42:57 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:59.658177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8bc8-2626-4987-be83-89d2e73aba8d None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.659120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8bc8-2626-4987-be83-89d2e73aba8d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.659120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8bc8-2626-4987-be83-89d2e73aba8d None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.660191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 607/1206] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:59.665686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.666111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.666340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.683620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.684835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.751831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 600/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:42:59.774380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8bc8-2626-4987-be83-89d2e73aba8d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.877027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8bc8-2626-4987-be83-89d2e73aba8d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.909155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.910487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.910762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.911052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.921487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:59.929603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:59.930818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:42:59.931816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 608/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:59.936870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.975585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.035209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f3a3-a27d-4601-9fed-096f97777a1b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.069432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.070102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.070393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.070677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.071420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.071730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.073143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.082467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 601/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.087751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.140477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.196865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e1cd-0aad-4d20-a853-e912317b3fe0 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.232327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.233157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.233445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.233726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.244588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.246058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:00.264104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.265113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.266203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:00.266203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:00.266203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.266203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:00.266203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 609/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.271236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.367753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.370664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae778-ebd0-41bd-81bf-ead12f8e8c4a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.406239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.406998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.407333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.407692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.408514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.408921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.411358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.423090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 602/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.428988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.532068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6becc-2439-4474-9dc2-1754ed6f50bc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.533527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.565510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.574633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.574633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.574633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.574633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.575790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:00.590812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.592039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:00.593158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 610/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.597763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.700664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a020669-914c-4ae2-805e-8d0aab6c1e13 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.734945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.735675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.735968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.736252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.737125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.737472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.739356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.757233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 603/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.763026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.867905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04740d-931d-4dbb-ae0c-c648e401f78d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.903177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.903853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.904143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.904426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.934573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.971314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.973409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.068515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 611/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:01.074458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.093508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.178360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52758edf-94fc-4720-89e2-cc553e1898be None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.213560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.214185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.214474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.214756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.228364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.229984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:01.247902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.248974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.250105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:01.250105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:01.250105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.250105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:01.250105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 604/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.256156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.319388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.357864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6239da-3156-43f6-a7db-c2f6bf6c9a16 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.392482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.393223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.393508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.393838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.394569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.394870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.396223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.407243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 612/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.414029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.485247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.515175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625c5f0-88ea-4763-a251-a4fbd7f76328 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.549179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.550019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.550808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.551088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.557501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.558960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:01.572347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.573280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:01.574201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 605/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.579617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.681675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a297-5a46-4e97-ba5d-f40f2a61665d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.704412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.716976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.717638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.717928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.718208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.718994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.719309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.720780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb75e3-ed09-4d95-b0cd-2399da98fcc6 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.733562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 613/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.740177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.839314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5cf0-603b-4e59-999a-b7607ae28303 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.867277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.872738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.873389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.873679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.873962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.874791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=e7ab313dcca44094b7f445a9a46eb170) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.875115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.876542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d5c5-8e7f-4817-9e42-6b2974912d78 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.882277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 606/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/role_assignments?user.id=e7ab313dcca44094b7f445a9a46eb170&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.067248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62eac8-8358-4951-933b-a10ac18199e0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.067856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62eac8-8358-4951-933b-a10ac18199e0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.067856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62eac8-8358-4951-933b-a10ac18199e0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.069184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 614/1220] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:04.074359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.074826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.074924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.091889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:04.093060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.158805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 607/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:04.181957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62eac8-8358-4951-933b-a10ac18199e0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.285908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62eac8-8358-4951-933b-a10ac18199e0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.319812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.320543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.320859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.321136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.331022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:04.338684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:04.339792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:04.341248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 615/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:04.345953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.444299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b67e-e668-4cf1-9d19-23b691eeb0d3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.467188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.478047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.478715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.479001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.479279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.480021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] RBAC: Adding query filter params (name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.480332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.481825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.490212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 608/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.497681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.548776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.607741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582e27-9903-4c68-9089-62132daff9b8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.643448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.644896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.645184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.645459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.655587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.657107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:04.674757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:04.675846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:04.676826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:04.676826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:04.676826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:04.676826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:04.676826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 616/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:04.681854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.782566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026f997-cccd-49ad-9c85-76dde307548e None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.818538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.819203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.819491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.819775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.820496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.820838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.822314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.835073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 609/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.840906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.947134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.953636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3df4a-641a-461f-aa49-3601a23bb48c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.987246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.988698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.988991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.989274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.996153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.997618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:05.013035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.014154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:05.015410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 617/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:05.020457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.069779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.122206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306e37-ea07-4b14-89ba-108c5f34b2aa None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.157185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.157868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.158158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.158439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.159792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.160391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.162623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.180910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 610/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:05.186765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.291530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e000c-2d4e-4543-ab7d-2e2d0abec758 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.324702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.325518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.325806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.326087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.336744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.338185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:05.356147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.357291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.358540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:05.358540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:05.358540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.358540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:05.358540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 618/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:05.363360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.460327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132abebf-2850-4558-9f1f-eac570842d9f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.462787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.493875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c24d5-a268-488e-8630-322a4621235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.494471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c24d5-a268-488e-8630-322a4621235f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.494758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c24d5-a268-488e-8630-322a4621235f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.495036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c24d5-a268-488e-8630-322a4621235f None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.495753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c24d5-a268-488e-8630-322a4621235f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.496063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c24d5-a268-488e-8630-322a4621235f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.497479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c24d5-a268-488e-8630-322a4621235f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.508237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 611/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:05.513851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.524038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.618121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007b79f-fe0b-43a3-bdf6-2817ce442844 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.652346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.653165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.653457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.653735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.661568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.663337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:05.677167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.678106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:05.679139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 619/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:05.684223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c24d5-a268-488e-8630-322a4621235f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.782039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c24d5-a268-488e-8630-322a4621235f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.814271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.814914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.815202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.816008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.816959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.817276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.818690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5554-96cc-45fb-9699-47a1b82af372 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.830153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 612/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:05.836863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.901902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.936090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e193d-72bf-460c-a2ba-f44c4fb021c2 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.969557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.970443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.970726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.970996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/e7ab313dcca44094b7f445a9a46eb170/roles/56b477843f1b4a8aaff755fda6005ce7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.985303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=e7ab313dcca44094b7f445a9a46eb170, role_id=56b477843f1b4a8aaff755fda6005ce7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.986744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e5c4f-07c2-4f43-95f1-40b85e6572e9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.085520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 620/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:43:05 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/e7ab313dcca44094b7f445a9a46eb170/roles/56b477843f1b4a8aaff755fda6005ce7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:08.307266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d75ee-4174-4be0-a594-5d94f8e70867 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.307812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d75ee-4174-4be0-a594-5d94f8e70867 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.307812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d75ee-4174-4be0-a594-5d94f8e70867 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.309210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 613/1233] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:08.314383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.317664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.317664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.330926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:08.332855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:08.398580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 621/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:08.422356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d75ee-4174-4be0-a594-5d94f8e70867 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.446700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.522291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d75ee-4174-4be0-a594-5d94f8e70867 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.555582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.556372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.556686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.556971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.567114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:08.574945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.576077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:08.577486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 614/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.582848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.628539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.681235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69037208-5404-49f0-9be8-22ada51acd47 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.714971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.715643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.715932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.716214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.716998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:08.717314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.718690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.728331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 622/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:08.734034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.820381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.835968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395fdd0-db57-4720-b283-b80a468075c0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.868744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.869534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.869871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.870203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.880940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.882410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:08.901057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.903914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.905059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:08.905059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:08.905059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.905059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:08.905059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 615/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.908053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.005525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c229-53ae-45c2-b588-84eba50a9ef5 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.014399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.038512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.039171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.039457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.039731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.040783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.042137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.053186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 623/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.058824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.157827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08abb1-d494-453a-8e2f-294f20aec4ab None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.195438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.196272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.196566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.196883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.199642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.204171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.206321 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:09.220138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.221306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:09.222463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 616/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.227144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.330081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f618b0-54df-4d73-8496-5c2a3d85e100 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.364807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.365474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.365764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.366045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.366990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.367305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.368879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.386194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 624/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.391891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.496038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9585-00bf-4457-9e8c-f7c8a9d1d133 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.529875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.530516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.530801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.531075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.591354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.597765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.599214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.695828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 617/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:09.701614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.730025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.799517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b738d-aac9-4de7-8a47-4651b77725d8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.832506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.833323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.833612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.833887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.843594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.845062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:09.862039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.863499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.864506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:09.864506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:09.864506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:09.864506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:09.864506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 625/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.869523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.964798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.970422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932e4f-f43e-41fd-a226-00d511e2e02f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.005387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.006048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.006339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.006623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.007338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.007652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.009067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.021132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 618/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.026726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.105052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.126011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fa43-f168-4856-b203-ad1fe80f6acf None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.160681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.161476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.162948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.163226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.169785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.171212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:10.184718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:10.185801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:10.187127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 626/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:10.191681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.294746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0009a-8ca1-4a5b-96d5-9d5454ce7ec5 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.329457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.330124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.330409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.330686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.331637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.332026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.333511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0931d0-53cb-4b12-bdda-d10dfc363941 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.345628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 619/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.352227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.451735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c71da-c574-466c-aae3-0bb6f0c9608c None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.484969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.485613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.485898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.486174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.486997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] RBAC: Adding query filter params (role.id=56b477843f1b4a8aaff755fda6005ce7, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=e7ab313dcca44094b7f445a9a46eb170) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.487898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.489328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa92d97-193f-4fbf-ad94-dde87c8322ee None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.495059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 627/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/role_assignments?user.id=e7ab313dcca44094b7f445a9a46eb170&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=56b477843f1b4a8aaff755fda6005ce7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:12.788778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdfe6-8309-4ebb-aa64-f9cd54dcc3b0 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.789350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdfe6-8309-4ebb-aa64-f9cd54dcc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.789350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdfe6-8309-4ebb-aa64-f9cd54dcc3b0 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.790754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 620/1247] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:12.795939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.796356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.796525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.801732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.813845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.815036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.880004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 628/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:12.903862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccdfe6-8309-4ebb-aa64-f9cd54dcc3b0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.926286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.010303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccdfe6-8309-4ebb-aa64-f9cd54dcc3b0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.045652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.046529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.046979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.047876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.058638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:13.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.067985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:13.068943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 621/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.073996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.171188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599a91c-d03f-468f-befe-6f9c6317717f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.204087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.209097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.209771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.210060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.210342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.211090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:13.211402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.212881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.221014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 629/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:13.229926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.310451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.333575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d97b57-458f-4a74-9f12-b5ae39f96a49 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.367480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.368267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.368556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.368865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.379197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.380678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:13.397325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.398241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.399174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:13.399174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:13.399174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.399174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:13.399174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 622/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.404245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.505031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48ff7-1e9e-4bd4-98d6-1c028e37a30a None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.540305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.540998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.541279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.541550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.542266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:13.542572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.543970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.556405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 630/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:13.562315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.663425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662a9b-2e04-4f50-93ae-32449bbde3be None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.689000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.696644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.697445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.697732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.698012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] PATH_INFO: `/v3/users/placement` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.705258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.707302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:13.721311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.722592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:13.723548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 623/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.729086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.783002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.828550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9da36-aba4-48f9-a5c7-c9c7855ba9c9 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.863181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.864582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.864582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.864582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.865264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:13.865576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.866997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.884030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 631/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:13.889913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.991104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f5061-153a-4566-8a59-6b12618bedfa None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.025480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.026170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.026463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.026748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.083859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.095974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.097952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.202106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 624/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:14.209169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.311101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f832f9b-a4b7-4bf3-b119-26d4a60f42e8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.325388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.346285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.347602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.347897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.348174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.358171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.359620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:14.377147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.378333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.379311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:14.379311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:14.379311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:14.379311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:14.379311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 632/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:14.384283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.469663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.481558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964344-136e-4fb9-ab6a-06add764ab86 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.513579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.514272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.514533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.514813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.515529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.515839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.517236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.529422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 625/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.535998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.632623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824c52b-3866-4f59-90c5-e168a9b079b8 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.667589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.668384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.668701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.668984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.675960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.677453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:14.691702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.692794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:14.693941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 633/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:14.699224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.802797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9a536-18b8-4829-9562-5725163c5529 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.836761 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.837416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.837700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.837975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.838752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.839060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.840478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e68b14-f351-4cb4-b1da-df8c518c4382 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.852300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 626/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.858758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.892185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.962200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcdd3-b38a-46c5-a24e-8699a1d746d7 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.996897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.997554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.997844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.998125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.998953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=e7ab313dcca44094b7f445a9a46eb170) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.999273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.000721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca78978-42d8-418a-810a-11eab8069acb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.007275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 634/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/role_assignments?user.id=e7ab313dcca44094b7f445a9a46eb170&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.228721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d782e4d-ac65-459c-9925-8e1c88b9e6d6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.229255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d782e4d-ac65-459c-9925-8e1c88b9e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.229404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d782e4d-ac65-459c-9925-8e1c88b9e6d6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.230848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 627/1261] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:17.236349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.236752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.236949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.254899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:17.256083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:17.326651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 635/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:17.351699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d782e4d-ac65-459c-9925-8e1c88b9e6d6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.362807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.451379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d782e4d-ac65-459c-9925-8e1c88b9e6d6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.485328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.486059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.486345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.486619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.496873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:17.504492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.505679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:17.506742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 628/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.511727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.530462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.609010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a387-72a8-4cf8-8559-982587d603ee None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.643136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.644729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.645036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.645316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.646076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.646384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.647759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.656126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 636/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.662854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.728230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.761093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e601ee-415d-49c5-998c-72b15fcc3927 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.794586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.795366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.795655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.795934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.807182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.808658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:17.825645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.826748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.828052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:17.828052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:17.828052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.828052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:17.828052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 629/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.833547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.913134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.931161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def019f9-2774-451e-a5fd-bc992e9b4023 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.964473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.965165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.965450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.965738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.966492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.966805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.968189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.980617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 637/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:17.986388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.088170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc989f-e08b-4a19-b78d-1e8a84ecd07f None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.107664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.121514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.128463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.128463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.128463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.130877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.132310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:18.146650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:18.147826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:18.149223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 630/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:18.153824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.262172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1623-033f-445e-ba93-2aba63d66ebb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.295751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.296419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.296737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.301705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.301705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.301705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.301705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.314254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.326110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 638/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.332770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.438303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2be6-dd03-41ab-955d-3bc2c2e3dfa0 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.472574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.473471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.473762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.474045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.484630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.486201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:18.504465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:18.509354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:18.510375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:18.510375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:18.510375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:18.510375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:18.510375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 631/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:18.511431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.610596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376a33b-1265-4e41-a228-4f021ffc088d None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.645721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.646439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.646728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.647010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.647750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.648067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.649496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.661935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 639/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.667589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.699404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.769313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913953f-448d-4239-b1dc-dc449c965821 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.802935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.803726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.804051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.804289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.810791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.812237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:18.826025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:18.827178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:18.828267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 632/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:18.833840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.891891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.933121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99f08-64ef-435b-986d-8eb6b5bd5612 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.973418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.973418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.973418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.973418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.973846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.973846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.973846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb364-b241-416b-b126-3bd4079bf746 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.981551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 640/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.988569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.081620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.089792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09f84-9525-494a-a47e-83ebd5b58557 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.122934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.123808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.124093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.124369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] PATH_INFO: `/v3/projects/450d5837471048de8055089f0c6bf7b6/users/e7ab313dcca44094b7f445a9a46eb170/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.126357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] RBAC: Authorizing `identity:create_grant(project_id=450d5837471048de8055089f0c6bf7b6, user_id=e7ab313dcca44094b7f445a9a46eb170, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.128450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387402ac-d903-4a57-b00b-f9651c86f953 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.237081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 633/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Wed May 25 14:43:18 2022] PUT /identity/v3/projects/450d5837471048de8055089f0c6bf7b6/users/e7ab313dcca44094b7f445a9a46eb170/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:21.460446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c5de-14f7-4805-8138-b49a8e98d1cc None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.461021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c5de-14f7-4805-8138-b49a8e98d1cc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.461128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c5de-14f7-4805-8138-b49a8e98d1cc None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.462438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 641/1274] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:21.467713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.468146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.468275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.485035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:21.489953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:21.553528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 634/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:21.577795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1c5de-14f7-4805-8138-b49a8e98d1cc None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.679153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1c5de-14f7-4805-8138-b49a8e98d1cc None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.696662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.714122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.714933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.715206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.715487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.727382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:21.737689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:21.745727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:21.746810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 642/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:21.747766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.827094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.844645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938184ad-5dfc-46d4-b41b-176fff901f7d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.876785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.877455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.878399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.878786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.879553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:21.879865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.881259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.889045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 635/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:21.894837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.995040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89167-1f2b-429b-9695-33a04a9f51bb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.037589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.038306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.038589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.038886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.053999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.056269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:22.077741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:22.078831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:22.079890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:22.079890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:22.079890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:22.079890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:22.079890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 643/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:22.086031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.185490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e61c-831c-434f-a48b-4f5ec61fd864 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.220153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.220854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.221139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.222042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.222760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:22.223182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.224468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.236139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 636/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:22.241935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.274531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.341055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862fa2-a55d-4644-903d-e20aa7957633 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.373660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.374454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.374742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.375019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.383263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.384727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:22.401826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:22.403563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:22.405461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 644/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:22.410903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.415153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.513219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2ab92-b207-42f1-8e5a-3db5f6d8eac3 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.546969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.547638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.547927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.548209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.549130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:22.549502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.551044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.572479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 637/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:22.578405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.668739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.678506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8869b-acb4-4f5e-b572-b0f8cfaa4edb None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.711505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.712182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.712448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.712961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.784528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.786044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.874492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.884856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 645/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:22.891001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.953401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.992953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1a97-0f6a-4c73-897c-f2594cc48b74 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.025542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.026328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.026613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.026890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.037864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.039294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:23.056566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:23.057683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:23.058813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:23.058813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:23.058813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:23.058813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:23.058813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 638/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:23.063761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.163873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e48b-c25b-4b90-91c1-3b8acc31b768 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.198503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.199163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.199490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.199813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.200594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:23.200931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.202291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.213863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 646/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:23.219647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.322923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f691c-9f8b-46f1-b039-261c0fc42673 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.337579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:23.357987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.358781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.359068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.359345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.366028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.367465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:23.382177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application with Lock( May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:23.396499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: ERROR keystone.server.flask.application May 25 14:43:23.397696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 639/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:23.398346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.440533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:23.491240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cee14-54b0-4fcf-8773-09a5002ed306 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.524874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.525568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.525850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.526130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.526916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:23.527231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.528682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0573681-7d45-4a3b-89ad-0c8ccfe4c469 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.541274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 647/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:23.547411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.645712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427733-c5ed-4827-a26c-ff55fe842f4a None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.678854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.679491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.679778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.680056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.680906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] RBAC: Adding query filter params (role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f, scope.project.id=450d5837471048de8055089f0c6bf7b6, user.id=e7ab313dcca44094b7f445a9a46eb170) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:23.681222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.682649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516c2e3-7f30-402b-aa13-00c61de1b82b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.690557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 640/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/role_assignments?user.id=e7ab313dcca44094b7f445a9a46eb170&scope.project.id=450d5837471048de8055089f0c6bf7b6&role.id=6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:25.957941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247360da-6f99-4d5c-ad21-22155aa1522a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.958506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247360da-6f99-4d5c-ad21-22155aa1522a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.958506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247360da-6f99-4d5c-ad21-22155aa1522a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.959881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 648/1288] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:25.965137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.965539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.965696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.983033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:25.984206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.013589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.049646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 641/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:26.072633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247360da-6f99-4d5c-ad21-22155aa1522a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.173516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247360da-6f99-4d5c-ad21-22155aa1522a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.184179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.208350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.209106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.209392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.209668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.210371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.211772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.223647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.224926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:26.226070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 649/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.231005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.331963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fe4f6-d8e1-4bd9-87a7-c6e0081ab5b8 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.368421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.369110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.369395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.369674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.370369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.370675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.372112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c348-d98b-4f32-9b92-bd0194040e28 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.376971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 642/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:26.382983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.484935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dd44-a7a4-4e04-b31e-c841f22767ac None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.517332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.517990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.518927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.519339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] PATH_INFO: `/v3/services` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.520084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.520396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.521803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b79986-f834-4619-bd94-4f56aac13a14 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.526231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 650/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:28.731802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3fc62-492b-4bf1-83a4-c4915f009cdd None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.732380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3fc62-492b-4bf1-83a4-c4915f009cdd None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.732380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3fc62-492b-4bf1-83a4-c4915f009cdd None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.733750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 643/1293] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:28.739460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38497b-d66c-4171-a7f7-bd8069f10245 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.739938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38497b-d66c-4171-a7f7-bd8069f10245 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.740045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38497b-d66c-4171-a7f7-bd8069f10245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.757420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8b38497b-d66c-4171-a7f7-bd8069f10245 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:28.758608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8b38497b-d66c-4171-a7f7-bd8069f10245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:28.790231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.829294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 651/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:28.852956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3fc62-492b-4bf1-83a4-c4915f009cdd None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.885555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.957654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3fc62-492b-4bf1-83a4-c4915f009cdd None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.993592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.994190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.994480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.994759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.995478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.996893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fabf8d-a627-4362-bbd8-2d17329e0572 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.156196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 644/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Wed May 25 14:43:28 2022] POST /identity/v3/services => generated 246 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:31.398815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7526b-2f9e-4a50-aaf7-e4dcdcef1b06 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.399368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7526b-2f9e-4a50-aaf7-e4dcdcef1b06 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.399368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7526b-2f9e-4a50-aaf7-e4dcdcef1b06 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.400794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 652/1296] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:31.406117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.406547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.406682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.423680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:31.424908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.512481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 645/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:31.536137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7526b-2f9e-4a50-aaf7-e4dcdcef1b06 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.637698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7526b-2f9e-4a50-aaf7-e4dcdcef1b06 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.670283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.671064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.671348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.671624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.672305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.673695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.686022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.687166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:31.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 653/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.695425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.712692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.792917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920064-3b72-45ec-8765-7e257964ed8e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.826524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.827197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.827490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.827774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.828484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.828836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.830212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.836326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 646/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:31.842514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.874859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.942877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588aaf-be42-452a-8b9d-0afe9addde21 None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.974457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.975101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.975382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.975653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.976433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] RBAC: Adding query filter params (interface=public, service_id=a4028a581c7d43968cbb5235ad66cf1b, region_id=RegionOne) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.976773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.979902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75332ae7-e2ba-459f-b5d4-c0272434a889 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.984236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 654/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/endpoints?service_id=a4028a581c7d43968cbb5235ad66cf1b&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:31.990619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.070062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.087257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485dd3-7b7a-4950-9da1-874c7c062521 None admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.119946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.120601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.120914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.121186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.121855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.123209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694334de-32b6-410a-af38-4ccc4201c88d None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.130487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 647/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:34.370839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64129-2821-4585-bfc2-3e852c8800cd None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.371360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64129-2821-4585-bfc2-3e852c8800cd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.371360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64129-2821-4585-bfc2-3e852c8800cd None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.372778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 655/1302] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:34.378222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.378745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.378843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.395075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.396253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:34.461394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 648/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:34.485781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb64129-2821-4585-bfc2-3e852c8800cd None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.583305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.589975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb64129-2821-4585-bfc2-3e852c8800cd None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.623788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.624642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.629520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.629520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] PATH_INFO: `/v3/services/placement` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.629520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.629520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:34.639704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:34.641344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 14:43:34.642254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 656/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:34.647644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.722480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.744358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903af1a-b159-4647-a4c2-54ad902e43fb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.777624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.778286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.778573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.778853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] PATH_INFO: `/v3/services` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.779554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:34.779862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.781260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3020-30e5-4213-a41d-2eab9dde129b None admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.787112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 649/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:34.792863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.891834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1ac4-8141-47d6-8a10-ed14f38adccc None admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.924937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.925588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.925874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.926154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.926882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.928244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716abf5-3084-4108-8e08-2329f66571c9 None admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.008465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 657/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:44.783273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=30 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.003710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:30.695869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432c6f-4ece-4c25-8266-95e2ee0c0a38 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.699238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432c6f-4ece-4c25-8266-95e2ee0c0a38 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.699238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432c6f-4ece-4c25-8266-95e2ee0c0a38 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.703003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da220fc-eb80-48f4-9c67-5d86926bad64 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.703431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da220fc-eb80-48f4-9c67-5d86926bad64 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.703645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da220fc-eb80-48f4-9c67-5d86926bad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.707614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 650/1307] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:30.790800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0da220fc-eb80-48f4-9c67-5d86926bad64 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:30.791920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0da220fc-eb80-48f4-9c67-5d86926bad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:30.933030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 658/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:30.968996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.969300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.969573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.971226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 651/1309] 10.222.0.57 () {54 vars in 964 bytes} [Wed May 25 14:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:30.977576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b703-2863-439f-bdb4-986017b56a42 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.978160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b703-2863-439f-bdb4-986017b56a42 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.978631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b703-2863-439f-bdb4-986017b56a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.063192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c337b703-2863-439f-bdb4-986017b56a42 None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:31.065305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c337b703-2863-439f-bdb4-986017b56a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.088158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:31.149720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 659/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Wed May 25 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:31.159061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.160934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.345889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3579a-c19e-4072-8a12-967b6af8b5b6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.475651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.479407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.479699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.479981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.483827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.555262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:31.612671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.614118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2508d-7f8b-4284-8f1f-8fdb3ff363e4 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.634461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 652/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:34.152092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:34.152641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:34.152743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:34.157583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 660/1312] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:34.160592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c73e-4c0b-481a-a05d-f8c058efab4d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:34.161043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c73e-4c0b-481a-a05d-f8c058efab4d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:34.161206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c73e-4c0b-481a-a05d-f8c058efab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:34.237500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a1b1c73e-4c0b-481a-a05d-f8c058efab4d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:34.238806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a1b1c73e-4c0b-481a-a05d-f8c058efab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:34.348963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 653/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:34.387229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:34.388923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:34.498848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf3f06-1eb8-47dc-a13d-99dc479ec15e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:34.574796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:34.577949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:34.578619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:34.578909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:34.579177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:34.581063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:34.696363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:34.697828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d2ba-ca16-48ca-af40-e61809deb13a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:34.716784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 661/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:37.507927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.508460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.508460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.509820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 654/1315] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:37.514895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d00d-8119-476f-89f1-b8151582369c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.515336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d00d-8119-476f-89f1-b8151582369c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.515446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d00d-8119-476f-89f1-b8151582369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.581161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2725d00d-8119-476f-89f1-b8151582369c None None] MFA Rules not processed for user `0d79746eda4c49dda869a0af4205213f`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:37.582374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2725d00d-8119-476f-89f1-b8151582369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:37.633864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:37.678287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 662/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:37.717290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.718821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:37.729168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:37.823960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1f49e-e2f6-4309-b0cd-3b9af77bb271 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.894915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.895559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.895845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.896124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.897783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:37.958054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:38.004065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:38.005542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c7451-baa8-43c2-98a8-fb17b88cd447 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:38.023203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 655/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:40.995254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.995761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.995761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.997126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 663/1318] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:41.002963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec18b3-132e-43d2-b807-bbb6664ca61a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.003398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec18b3-132e-43d2-b807-bbb6664ca61a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.003522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec18b3-132e-43d2-b807-bbb6664ca61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.067073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0fec18b3-132e-43d2-b807-bbb6664ca61a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:41.068262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0fec18b3-132e-43d2-b807-bbb6664ca61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:41.165412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 656/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:41.207106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.208704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:41.315287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1da22-0f5c-45fc-ab2b-435083ef28d6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.386642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.387375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.387617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.387895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.389545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:41.397125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:41.497146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.498567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891e39c-72eb-4539-bcf1-905308b0edf2 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.515756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 664/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:44.752353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.752917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.753038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.754640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 657/1321] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:44.759621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c037f38-764a-45e7-8b21-c286261b534f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.760015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c037f38-764a-45e7-8b21-c286261b534f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.760183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c037f38-764a-45e7-8b21-c286261b534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.824244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-4c037f38-764a-45e7-8b21-c286261b534f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:44.825481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4c037f38-764a-45e7-8b21-c286261b534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.883634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.933078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 665/1322] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:44.968328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.969881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.989150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:45.074011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352a5c2-83b8-43b2-9f81-443268b20a08 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:45.149560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:45.150220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.150503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.150777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.152408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:45.227378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:45.265309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:45.266752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a605ce-54e7-48a4-abed-85eb33a10b2b service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:45.286116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 658/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:47.597623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:47.598145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:47.598145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:47.599472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 666/1324] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:47.604848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e26df5-b853-4f6e-9a42-2a6adc137def None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:47.605289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e26df5-b853-4f6e-9a42-2a6adc137def None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:47.605398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e26df5-b853-4f6e-9a42-2a6adc137def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:47.675221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-32e26df5-b853-4f6e-9a42-2a6adc137def None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:47.676424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-32e26df5-b853-4f6e-9a42-2a6adc137def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:47.783505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 659/1325] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:47.819519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:47.821094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:47.929974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0086083-750c-4180-bcb0-d09c077d3b1f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.004874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.005528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.005815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.006093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.007731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.024472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:48.117223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.118668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a720e5-a514-45a5-b9ae-032503e632e4 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.137053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 667/1326] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:50.422538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329264-01c9-4481-977c-8893368ac9f4 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.423594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329264-01c9-4481-977c-8893368ac9f4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.423758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49329264-01c9-4481-977c-8893368ac9f4 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.425133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 660/1327] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:50.430321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a853e2b-01f3-46b3-a41f-21d5f1c292bd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.430774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a853e2b-01f3-46b3-a41f-21d5f1c292bd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.430958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a853e2b-01f3-46b3-a41f-21d5f1c292bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.496396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8a853e2b-01f3-46b3-a41f-21d5f1c292bd None None] MFA Rules not processed for user `0d79746eda4c49dda869a0af4205213f`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:50.497544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8a853e2b-01f3-46b3-a41f-21d5f1c292bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.562879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.594651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 668/1328] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:50.647629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.647929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.648217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.649640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 661/1329] 10.222.0.57 () {54 vars in 964 bytes} [Wed May 25 14:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:50.655997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762f0-d06b-4e77-b727-d76bbd4cbe43 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.656296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762f0-d06b-4e77-b727-d76bbd4cbe43 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.656581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762f0-d06b-4e77-b727-d76bbd4cbe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.737540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a24762f0-d06b-4e77-b727-d76bbd4cbe43 None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:50.738788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a24762f0-d06b-4e77-b727-d76bbd4cbe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.814636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 669/1330] 10.222.0.57 () {58 vars in 1061 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:50.823591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.825174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.856343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.932018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4a435-64b6-490b-90b4-11f86890c55c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:51.010770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:51.011428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.011711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.011983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:51.013632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:51.090485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:51.121967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:51.123417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4290d-bee9-4b44-bc3c-bb2569ee501d service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:51.142564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 662/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:54.322618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.323084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.323195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.324818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 670/1332] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:54.330381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02b11e-be98-48d1-9e4f-aa708188eb8b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.330764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02b11e-be98-48d1-9e4f-aa708188eb8b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.330764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02b11e-be98-48d1-9e4f-aa708188eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.396331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9c02b11e-be98-48d1-9e4f-aa708188eb8b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:54.397579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9c02b11e-be98-48d1-9e4f-aa708188eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.498559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 663/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:54.534435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.535962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.605962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:54.638871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32d6f-ed05-4415-85ac-b9761082e26e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.716784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.717527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.717662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.717905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.719557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.835748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.837247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf568-fbb1-4d12-b122-037a862874c1 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:54.849573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:54.865465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 671/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:57.188106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:57.189389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:57.189389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:57.190729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 664/1335] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:49:57.196109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf463e-23e6-4413-8c32-427f93acf652 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:57.196541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf463e-23e6-4413-8c32-427f93acf652 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:57.196720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf463e-23e6-4413-8c32-427f93acf652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:57.268769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-47bf463e-23e6-4413-8c32-427f93acf652 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:57.270024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-47bf463e-23e6-4413-8c32-427f93acf652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:57.369957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 672/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:57.410832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:57.412355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:57.452218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:57.514504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9c32-f208-45f1-a543-c070ef9bd85f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:57.587119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:57.587777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:57.588065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:57.588345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:57.590033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:57.671726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:57.698265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:57.699723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255b6d-2a09-4e42-8019-e2c99cf8cfe5 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:57.718870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 665/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:00.616418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.617037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.617037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.618290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 673/1338] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:00.623418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0c43-98b3-48f9-98e9-9feea5f40fe6 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.623820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0c43-98b3-48f9-98e9-9feea5f40fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.623997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0c43-98b3-48f9-98e9-9feea5f40fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.687497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7b9e0c43-98b3-48f9-98e9-9feea5f40fe6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:00.688874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7b9e0c43-98b3-48f9-98e9-9feea5f40fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:00.785598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 666/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:00.820509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.823509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:00.902333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:00.934829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f14cda-47bc-4f3f-89aa-a1bf54b31ce8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.939032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.939676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.939960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.940243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.942546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:01.042670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.044107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672df50c-a937-4ce2-a4fe-7883c40c26e2 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.063254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 674/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:05.643246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c6c2-3214-457d-9703-9034f677e232 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:05.643730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c6c2-3214-457d-9703-9034f677e232 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:05.643839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c6c2-3214-457d-9703-9034f677e232 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:05.645430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 667/1341] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:05.650514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56eece-569d-488e-80b5-cb4c4a47939e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:05.650931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56eece-569d-488e-80b5-cb4c4a47939e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:05.651085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56eece-569d-488e-80b5-cb4c4a47939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:05.697513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-de56eece-569d-488e-80b5-cb4c4a47939e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:05.698720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-de56eece-569d-488e-80b5-cb4c4a47939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:05.760546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:05.782252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 675/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:05.820062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01c6c2-3214-457d-9703-9034f677e232 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:05.832085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01c6c2-3214-457d-9703-9034f677e232 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:05.835525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:05.836162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:05.836532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:05.836746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:05.845588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:05.847013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1d84-e582-4a2c-add4-f5cd04233b3c service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:05.856106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 668/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:09.025692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8544-34bf-4ba5-bbe0-7aab0a1b467c None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.026216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8544-34bf-4ba5-bbe0-7aab0a1b467c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.026216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8544-34bf-4ba5-bbe0-7aab0a1b467c None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.027520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 676/1344] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:09.034009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2e2d-114b-4143-86d2-6ac8614d4447 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.034423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2e2d-114b-4143-86d2-6ac8614d4447 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.034584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2e2d-114b-4143-86d2-6ac8614d4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.061523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-726c2e2d-114b-4143-86d2-6ac8614d4447 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:09.062719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-726c2e2d-114b-4143-86d2-6ac8614d4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:09.070520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 669/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:09.108019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac8544-34bf-4ba5-bbe0-7aab0a1b467c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.119905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac8544-34bf-4ba5-bbe0-7aab0a1b467c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.123627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.124281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.124565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.124894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.134542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.135981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c619-f1d9-43d8-9164-a06e6f27aedc service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.146730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 677/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:13.607204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c94e3a-7367-4d99-8ab5-c0eab13c7e06 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.607765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c94e3a-7367-4d99-8ab5-c0eab13c7e06 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.607765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c94e3a-7367-4d99-8ab5-c0eab13c7e06 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.609205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 670/1347] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:50:13.615947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931158-5250-4482-a648-301bcfc23fee None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.616381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931158-5250-4482-a648-301bcfc23fee None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.616587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931158-5250-4482-a648-301bcfc23fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.635325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-39931158-5250-4482-a648-301bcfc23fee None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:13.636526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-39931158-5250-4482-a648-301bcfc23fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:13.644404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 678/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:13.682861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c94e3a-7367-4d99-8ab5-c0eab13c7e06 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.694378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c94e3a-7367-4d99-8ab5-c0eab13c7e06 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.697837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.698480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.698764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.699044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.708022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.709490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c67b20-dc35-4f57-94d9-e79c40d78f76 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.718699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 671/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:19.315729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc0961-0037-4986-92bd-6e7586ef1857 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.316293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc0961-0037-4986-92bd-6e7586ef1857 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.316778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc0961-0037-4986-92bd-6e7586ef1857 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.321345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 679/1350] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:50:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:19.330725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb0f7-7dd4-4330-a911-d063e9770f99 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.331605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb0f7-7dd4-4330-a911-d063e9770f99 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.332038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb0f7-7dd4-4330-a911-d063e9770f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.338544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:19.424179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e92eb0f7-7dd4-4330-a911-d063e9770f99 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:19.425536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e92eb0f7-7dd4-4330-a911-d063e9770f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.543630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 672/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:23.629756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=15 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:23.770276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308268-4ad8-4ed0-9a88-a7354db52942 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:23.770564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308268-4ad8-4ed0-9a88-a7354db52942 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:23.771041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308268-4ad8-4ed0-9a88-a7354db52942 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:23.772413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 680/1352] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:23.777448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333a13-8533-4b10-99bb-6764c157ac98 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:23.777948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333a13-8533-4b10-99bb-6764c157ac98 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:23.778033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333a13-8533-4b10-99bb-6764c157ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:23.797857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-00333a13-8533-4b10-99bb-6764c157ac98 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:23.799211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-00333a13-8533-4b10-99bb-6764c157ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:23.808083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 673/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:25.367037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac55f8-c98e-435d-9a4d-8658a0225d61 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:25.367597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac55f8-c98e-435d-9a4d-8658a0225d61 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:25.367597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac55f8-c98e-435d-9a4d-8658a0225d61 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:25.368990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 681/1354] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:25.373905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c453c1-0765-4a1e-965f-24a0e5a17810 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:25.374358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c453c1-0765-4a1e-965f-24a0e5a17810 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:25.374473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c453c1-0765-4a1e-965f-24a0e5a17810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:25.393625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a9c453c1-0765-4a1e-965f-24a0e5a17810 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:25.394831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a9c453c1-0765-4a1e-965f-24a0e5a17810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:25.403347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 674/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:29.260182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f589-2960-4a30-90d4-63125307fa41 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.260783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f589-2960-4a30-90d4-63125307fa41 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.260783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f589-2960-4a30-90d4-63125307fa41 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.263687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 682/1356] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:29.268166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b753-bfd5-47b0-9d52-5ea3029d2e2c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.268719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b753-bfd5-47b0-9d52-5ea3029d2e2c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.268817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b753-bfd5-47b0-9d52-5ea3029d2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.290400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-33c2b753-bfd5-47b0-9d52-5ea3029d2e2c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:29.291649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-33c2b753-bfd5-47b0-9d52-5ea3029d2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:29.300825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 675/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:29.360104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d114d7-4853-4d4b-a69f-a5c58dce412a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.360953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d114d7-4853-4d4b-a69f-a5c58dce412a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.361468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d114d7-4853-4d4b-a69f-a5c58dce412a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.364250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 683/1358] 10.222.0.57 () {54 vars in 961 bytes} [Wed May 25 14:50:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:29.371842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d858f6-f705-4878-9f6e-77b6a2ac5073 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.376564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d858f6-f705-4878-9f6e-77b6a2ac5073 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.376564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d858f6-f705-4878-9f6e-77b6a2ac5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.429288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-20d858f6-f705-4878-9f6e-77b6a2ac5073 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:29.430485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-20d858f6-f705-4878-9f6e-77b6a2ac5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:29.488771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:29.521064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 676/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Wed May 25 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:29.529827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d114d7-4853-4d4b-a69f-a5c58dce412a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:29.546975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d114d7-4853-4d4b-a69f-a5c58dce412a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:29.552762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:29.553407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.553695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.553975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.563138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:29.564768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e64e1-3ad2-45cb-922f-97da4762baa3 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:29.574485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 684/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:32.023505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac83-8c60-4f71-bf5d-88f0aa0b287c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:32.024062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac83-8c60-4f71-bf5d-88f0aa0b287c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:32.024062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac83-8c60-4f71-bf5d-88f0aa0b287c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:32.025642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 677/1361] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:32.031553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e5d-ec1f-4c7f-abff-7beb5894ddc1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:32.032002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e5d-ec1f-4c7f-abff-7beb5894ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:32.032106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e5d-ec1f-4c7f-abff-7beb5894ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:32.050186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2cf88e5d-ec1f-4c7f-abff-7beb5894ddc1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:32.051393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2cf88e5d-ec1f-4c7f-abff-7beb5894ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:32.059230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 685/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:32.104145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aac83-8c60-4f71-bf5d-88f0aa0b287c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:32.119656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aac83-8c60-4f71-bf5d-88f0aa0b287c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:32.125687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:32.126417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:32.126777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:32.127135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:32.136347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:32.138084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d774-71e3-426b-8acb-0b408ed7d3f5 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:32.149856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 678/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:34.882472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7a33-0ede-4426-8eb6-ca772536a7a4 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:34.882967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7a33-0ede-4426-8eb6-ca772536a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:34.883086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7a33-0ede-4426-8eb6-ca772536a7a4 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:34.884435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 686/1364] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:34.889893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04066-4924-4b03-8637-2081cb3d90bb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:34.890398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04066-4924-4b03-8637-2081cb3d90bb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:34.890495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04066-4924-4b03-8637-2081cb3d90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:34.908987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7ce04066-4924-4b03-8637-2081cb3d90bb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:34.910192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7ce04066-4924-4b03-8637-2081cb3d90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:34.918090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 679/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:34.966917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96d18e-2e69-489e-97f8-e800ed778c03 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:34.967146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96d18e-2e69-489e-97f8-e800ed778c03 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:34.967431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96d18e-2e69-489e-97f8-e800ed778c03 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:34.969196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 687/1366] 10.222.0.57 () {54 vars in 961 bytes} [Wed May 25 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:34.974609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb52c9-d3fb-4135-a5f2-a7b0b827445a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:34.974910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb52c9-d3fb-4135-a5f2-a7b0b827445a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:34.975197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb52c9-d3fb-4135-a5f2-a7b0b827445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:34.996908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fdeb52c9-d3fb-4135-a5f2-a7b0b827445a None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:34.998102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fdeb52c9-d3fb-4135-a5f2-a7b0b827445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:35.007940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 680/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Wed May 25 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:35.016385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96d18e-2e69-489e-97f8-e800ed778c03 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:35.034199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96d18e-2e69-489e-97f8-e800ed778c03 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:35.039828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:35.040493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:35.040815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:35.041099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:35.051930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:35.053604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d1f94-8c49-4186-89c3-8e7e04543c15 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:35.064873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 688/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:37.502824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e138-df7b-4aa5-9c98-84494accdf4b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.503344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e138-df7b-4aa5-9c98-84494accdf4b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.503344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e138-df7b-4aa5-9c98-84494accdf4b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.504885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 681/1369] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:37.509981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40946-cf87-4af5-8591-77b2a3cb0fdc None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.510753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40946-cf87-4af5-8591-77b2a3cb0fdc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.511053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40946-cf87-4af5-8591-77b2a3cb0fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.529900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-10b40946-cf87-4af5-8591-77b2a3cb0fdc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:37.531133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-10b40946-cf87-4af5-8591-77b2a3cb0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:37.539110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 689/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:37.584028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e138-df7b-4aa5-9c98-84494accdf4b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:37.599780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e138-df7b-4aa5-9c98-84494accdf4b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:37.605990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:37.606837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.607230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.607615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.617385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:37.619160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4119-3ab0-4032-bfb4-8aeac0c050e1 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:37.629567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 682/1371] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:37.776911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c4074-38a4-452f-a15d-ebb0585276e8 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.777155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c4074-38a4-452f-a15d-ebb0585276e8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.777438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c4074-38a4-452f-a15d-ebb0585276e8 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.779128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 690/1372] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:37.785080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898adfa-faa5-44e6-baeb-7243b67c4942 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.785459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898adfa-faa5-44e6-baeb-7243b67c4942 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.785845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898adfa-faa5-44e6-baeb-7243b67c4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.804938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9898adfa-faa5-44e6-baeb-7243b67c4942 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:37.806238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9898adfa-faa5-44e6-baeb-7243b67c4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:37.816128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 683/1373] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:38.145100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472735e-826c-422c-9ee1-6af2c0f9a031 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.145576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472735e-826c-422c-9ee1-6af2c0f9a031 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.146078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472735e-826c-422c-9ee1-6af2c0f9a031 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.147801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 691/1374] 10.222.0.57 () {54 vars in 963 bytes} [Wed May 25 14:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:38.154587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051eb2-6266-4cc6-a007-34420b80f359 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.155045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051eb2-6266-4cc6-a007-34420b80f359 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.155551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051eb2-6266-4cc6-a007-34420b80f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.211464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-5c051eb2-6266-4cc6-a007-34420b80f359 None None] MFA Rules not processed for user `d6d25014e11e4765b66fc04586547473`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:38.212887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5c051eb2-6266-4cc6-a007-34420b80f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.289094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 684/1375] 10.222.0.57 () {58 vars in 1060 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:38.297945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472735e-826c-422c-9ee1-6af2c0f9a031 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.311444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472735e-826c-422c-9ee1-6af2c0f9a031 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.315772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.316546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.316999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.317468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.328108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:38.330122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4f403-9a21-4f6f-b785-5bfab5db0e50 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.341371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 692/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:40.049895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b47d-b8d3-4f1a-8910-c202af85e299 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:40.050432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b47d-b8d3-4f1a-8910-c202af85e299 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:40.050551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b47d-b8d3-4f1a-8910-c202af85e299 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:40.051865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 685/1377] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:40.057274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618454-cf6a-4d8f-bae5-6fe7be6a6c68 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:40.057672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618454-cf6a-4d8f-bae5-6fe7be6a6c68 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:40.057835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618454-cf6a-4d8f-bae5-6fe7be6a6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:40.075851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1c618454-cf6a-4d8f-bae5-6fe7be6a6c68 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:40.077515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1c618454-cf6a-4d8f-bae5-6fe7be6a6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:40.088232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 693/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:40.138832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b47d-b8d3-4f1a-8910-c202af85e299 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:40.154681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b47d-b8d3-4f1a-8910-c202af85e299 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:40.160552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:40.161344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:40.161700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:40.162048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:40.171469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:40.173289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc397ebc-a43e-4613-833d-6eaf2293670c service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:40.185576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 686/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:42.570203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b419-7d19-4cbd-827c-5fc9f8a60e36 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.571060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b419-7d19-4cbd-827c-5fc9f8a60e36 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.571360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b419-7d19-4cbd-827c-5fc9f8a60e36 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.573259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 694/1380] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:42.579252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114dcb-7c32-4a88-91f7-866b7cd0301f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.579721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114dcb-7c32-4a88-91f7-866b7cd0301f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.579817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114dcb-7c32-4a88-91f7-866b7cd0301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.603054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d7114dcb-7c32-4a88-91f7-866b7cd0301f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:42.604637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d7114dcb-7c32-4a88-91f7-866b7cd0301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:42.613845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 687/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:42.658013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917b419-7d19-4cbd-827c-5fc9f8a60e36 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:42.673786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917b419-7d19-4cbd-827c-5fc9f8a60e36 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:42.679349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:42.680090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.680448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.680826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.690213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:42.691885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af7f32-2108-4634-879b-db9dde5a77ce service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:42.702749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 695/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:45.095597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea087b1-0071-4d60-900d-e680eed743f9 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:45.098135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea087b1-0071-4d60-900d-e680eed743f9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:45.098135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea087b1-0071-4d60-900d-e680eed743f9 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:45.098135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 688/1383] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:45.102813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec37f3-e6da-4aca-a96a-c21a4b2fc356 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:45.103251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec37f3-e6da-4aca-a96a-c21a4b2fc356 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:45.103388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec37f3-e6da-4aca-a96a-c21a4b2fc356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:45.122433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6eec37f3-e6da-4aca-a96a-c21a4b2fc356 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:45.123971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6eec37f3-e6da-4aca-a96a-c21a4b2fc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:45.132593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 696/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:45.177901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea087b1-0071-4d60-900d-e680eed743f9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:45.193605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea087b1-0071-4d60-900d-e680eed743f9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:45.200376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:45.201310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:45.201605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:45.201891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:45.211275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:45.212891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f62e14-1d97-4dcc-96c0-d9322dfcfdd0 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:45.225230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 689/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:47.502426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd37a-3f56-4a69-96b8-2455d67c0931 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:47.503079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd37a-3f56-4a69-96b8-2455d67c0931 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:47.503079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd37a-3f56-4a69-96b8-2455d67c0931 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:47.504233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 697/1386] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:47.510085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99380d-50bc-4cce-a1a5-f0601c3758a7 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:47.510688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99380d-50bc-4cce-a1a5-f0601c3758a7 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:47.510798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99380d-50bc-4cce-a1a5-f0601c3758a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:47.531861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1d99380d-50bc-4cce-a1a5-f0601c3758a7 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:47.533360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d99380d-50bc-4cce-a1a5-f0601c3758a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:47.542512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 690/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:47.589124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd37a-3f56-4a69-96b8-2455d67c0931 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:47.603828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd37a-3f56-4a69-96b8-2455d67c0931 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:47.609964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:47.610562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:47.610846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:47.611125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:47.619609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:47.621242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14903574-cccb-4023-ac67-ce8db88e4945 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:47.631405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 698/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:50.224991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33589-b9be-4d39-bc53-b3c9204bbce3 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:50.225584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33589-b9be-4d39-bc53-b3c9204bbce3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:50.225584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33589-b9be-4d39-bc53-b3c9204bbce3 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:50.226946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 691/1389] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:50.232304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835e77-9f80-47d4-a2b8-e6ef83e9a508 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:50.232884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835e77-9f80-47d4-a2b8-e6ef83e9a508 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:50.232884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835e77-9f80-47d4-a2b8-e6ef83e9a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:50.252736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-50835e77-9f80-47d4-a2b8-e6ef83e9a508 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:50.254136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-50835e77-9f80-47d4-a2b8-e6ef83e9a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:50.263267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 699/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:50.309286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d33589-b9be-4d39-bc53-b3c9204bbce3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:50.326252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d33589-b9be-4d39-bc53-b3c9204bbce3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:50.331723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:50.332384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:50.332704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:50.332994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:50.341703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:50.344535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e6f71-c854-49f5-8a34-2d0af77db83d service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:50.354523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 692/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:52.858717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093439c-cd0e-4727-aea5-51e23bdf17f9 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:52.859317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093439c-cd0e-4727-aea5-51e23bdf17f9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:52.859317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093439c-cd0e-4727-aea5-51e23bdf17f9 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:52.860667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 700/1392] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:52.866059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564d13-cd8b-448a-b724-d0fd259eba8c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:52.866572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564d13-cd8b-448a-b724-d0fd259eba8c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:52.866683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564d13-cd8b-448a-b724-d0fd259eba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:52.885294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7f564d13-cd8b-448a-b724-d0fd259eba8c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:52.886476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7f564d13-cd8b-448a-b724-d0fd259eba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:52.894881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 693/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:52.939994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093439c-cd0e-4727-aea5-51e23bdf17f9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:52.954955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093439c-cd0e-4727-aea5-51e23bdf17f9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:52.960401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:52.961080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:52.961369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:52.961648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:52.971260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:52.972880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566423f-cc21-41b9-8691-415fdab7aa59 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:52.982680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 701/1394] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:54.761277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e42ec-cad3-4340-8105-5c6f4f06d267 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:54.761871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e42ec-cad3-4340-8105-5c6f4f06d267 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:54.761871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e42ec-cad3-4340-8105-5c6f4f06d267 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:54.763293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 694/1395] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:54.770482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658c36-def4-4d26-839e-4330f9758c25 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:54.771014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658c36-def4-4d26-839e-4330f9758c25 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:54.771110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658c36-def4-4d26-839e-4330f9758c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:54.777255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=52 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:54.792186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-03658c36-def4-4d26-839e-4330f9758c25 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:54.799623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-03658c36-def4-4d26-839e-4330f9758c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:54.803618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 702/1396] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:54.871641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db30a-4162-4b79-8859-9b028715e72a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:54.872054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db30a-4162-4b79-8859-9b028715e72a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:54.872350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db30a-4162-4b79-8859-9b028715e72a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:54.874675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 695/1397] 10.222.0.57 () {54 vars in 962 bytes} [Wed May 25 14:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:54.880471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7cd9-481e-41d5-8a1b-65b1c5708de7 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:54.880845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7cd9-481e-41d5-8a1b-65b1c5708de7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:54.881129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7cd9-481e-41d5-8a1b-65b1c5708de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:54.944804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d48f7cd9-481e-41d5-8a1b-65b1c5708de7 None None] MFA Rules not processed for user `9548a1d963a644559c769715d0d58c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:54.946055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d48f7cd9-481e-41d5-8a1b-65b1c5708de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:55.022415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 703/1398] 10.222.0.57 () {58 vars in 1059 bytes} [Wed May 25 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:55.030645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db30a-4162-4b79-8859-9b028715e72a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:55.044727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db30a-4162-4b79-8859-9b028715e72a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:55.048573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:55.049271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.049561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.049844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.068498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:55.071475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cb2a8-9281-4a3e-aac9-45d61db3f902 service glance] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:55.080003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:55.087196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 696/1399] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:55.524399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de24a1-cc9a-46e8-a963-0b674c5e8540 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.524721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de24a1-cc9a-46e8-a963-0b674c5e8540 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.525007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de24a1-cc9a-46e8-a963-0b674c5e8540 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.526434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 704/1400] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:55.532760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629cd4-6228-4f59-90dd-2257c5792a6a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.533058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629cd4-6228-4f59-90dd-2257c5792a6a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.533337 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629cd4-6228-4f59-90dd-2257c5792a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.551806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-80629cd4-6228-4f59-90dd-2257c5792a6a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:55.553068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-80629cd4-6228-4f59-90dd-2257c5792a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:55.561140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 697/1401] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:55.605718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de24a1-cc9a-46e8-a963-0b674c5e8540 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:55.621598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de24a1-cc9a-46e8-a963-0b674c5e8540 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:55.627713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:55.628491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.628884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.629237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.638039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:55.639788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66177a-43f0-415a-963a-a5fc3ab66904 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:55.649480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 705/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:55.751776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20507-12ea-4883-b7d3-cba1c343b46e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.752080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20507-12ea-4883-b7d3-cba1c343b46e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.752363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20507-12ea-4883-b7d3-cba1c343b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.802712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2df20507-12ea-4883-b7d3-cba1c343b46e None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:55.803918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2df20507-12ea-4883-b7d3-cba1c343b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:55.871013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 698/1403] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:55.914348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262dbb-77fa-4edb-9f65-bd08ac75be10 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.914901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262dbb-77fa-4edb-9f65-bd08ac75be10 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.914901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262dbb-77fa-4edb-9f65-bd08ac75be10 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.916335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 706/1404] 10.222.0.57 () {54 vars in 942 bytes} [Wed May 25 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:55.924483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0444-8e2c-440d-a383-92dc6ffc3d4d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:55.924814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0444-8e2c-440d-a383-92dc6ffc3d4d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:55.925101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0444-8e2c-440d-a383-92dc6ffc3d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:55.980288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c08e0444-8e2c-440d-a383-92dc6ffc3d4d None None] MFA Rules not processed for user `24ea77596372484aaefd59eaad6403ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:55.981744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c08e0444-8e2c-440d-a383-92dc6ffc3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:56.057049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 699/1405] 10.222.0.57 () {58 vars in 1039 bytes} [Wed May 25 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:56.067206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262dbb-77fa-4edb-9f65-bd08ac75be10 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:56.081233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262dbb-77fa-4edb-9f65-bd08ac75be10 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:56.086150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:56.086795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:56.087085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:56.087366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:56.095659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:56.099214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57cc8-0142-46d7-a5b8-ff7dfef202da service swift] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:56.105364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 707/1406] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 14:50:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:50:58.104828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b779-f697-468c-ad8a-37ee1a373bef None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:58.105435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b779-f697-468c-ad8a-37ee1a373bef None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:58.105435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b779-f697-468c-ad8a-37ee1a373bef None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:58.107178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 700/1407] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:58.113957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a8ab-9dad-44f7-ad1a-f88553add797 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:58.114413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a8ab-9dad-44f7-ad1a-f88553add797 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:58.114565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a8ab-9dad-44f7-ad1a-f88553add797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:58.132861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-46c9a8ab-9dad-44f7-ad1a-f88553add797 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:58.134062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-46c9a8ab-9dad-44f7-ad1a-f88553add797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:58.142870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 708/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:58.194388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148b779-f697-468c-ad8a-37ee1a373bef None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:58.209663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148b779-f697-468c-ad8a-37ee1a373bef None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:58.226382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:58.227056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:58.227345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:58.227627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:58.245862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:58.247512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08afd-dee6-4ad2-bb25-703f5ef6a787 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:58.258370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 701/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:08.127397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=55 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:08.284116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:20.575293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102b25-70e5-41e2-b5e9-445ae2b7ec75 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:20.576551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102b25-70e5-41e2-b5e9-445ae2b7ec75 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:20.576551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102b25-70e5-41e2-b5e9-445ae2b7ec75 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:20.577879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 709/1410] 10.222.0.57 () {54 vars in 918 bytes} [Wed May 25 14:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:20.582882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d78c3b-fa4d-4100-b0b9-93c600d52c0c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:20.583384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d78c3b-fa4d-4100-b0b9-93c600d52c0c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:20.583495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d78c3b-fa4d-4100-b0b9-93c600d52c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:20.601977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a4d78c3b-fa4d-4100-b0b9-93c600d52c0c None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:20.603208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a4d78c3b-fa4d-4100-b0b9-93c600d52c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:20.612508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 702/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Wed May 25 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:51:20.626638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f9cf-8def-4e92-bb27-5521d4545973 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:20.626934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f9cf-8def-4e92-bb27-5521d4545973 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:20.627218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f9cf-8def-4e92-bb27-5521d4545973 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:20.628593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 710/1412] 10.222.0.57 () {54 vars in 918 bytes} [Wed May 25 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:20.633192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ac20-93f0-4cc4-a0b7-4b85e10bb2b9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:20.633488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ac20-93f0-4cc4-a0b7-4b85e10bb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:20.633770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ac20-93f0-4cc4-a0b7-4b85e10bb2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:20.651332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3992ac20-93f0-4cc4-a0b7-4b85e10bb2b9 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:20.652512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3992ac20-93f0-4cc4-a0b7-4b85e10bb2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:20.662317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 703/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Wed May 25 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:23.371154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbb14-b13e-43c1-bc1b-1e95b03e96e6 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:23.371722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbb14-b13e-43c1-bc1b-1e95b03e96e6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:23.371722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbb14-b13e-43c1-bc1b-1e95b03e96e6 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:23.373140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:23.378327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5534b4-1bc3-44a8-bda9-e5f7b9109a33 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:23.378776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5534b4-1bc3-44a8-bda9-e5f7b9109a33 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:23.378883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5534b4-1bc3-44a8-bda9-e5f7b9109a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:23.396784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4a5534b4-1bc3-44a8-bda9-e5f7b9109a33 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:23.397983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4a5534b4-1bc3-44a8-bda9-e5f7b9109a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:23.406562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:23.449115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbb14-b13e-43c1-bc1b-1e95b03e96e6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:23.463101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbb14-b13e-43c1-bc1b-1e95b03e96e6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:23.469039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:23.469674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:23.469960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:23.470240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:23.478343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:23.479913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae9516-e603-485d-b415-43a791805d27 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:23.494875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 712/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:24.481359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363621b5-af0b-47bb-881f-8d85cfe42853 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:24.482518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363621b5-af0b-47bb-881f-8d85cfe42853 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:24.482821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363621b5-af0b-47bb-881f-8d85cfe42853 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:24.484224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:24.489255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f1b-fb2f-4078-b106-289e85d5330c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:24.489694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f1b-fb2f-4078-b106-289e85d5330c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:24.489805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f1b-fb2f-4078-b106-289e85d5330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:24.507450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-15f58f1b-fb2f-4078-b106-289e85d5330c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:24.508664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-15f58f1b-fb2f-4078-b106-289e85d5330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:24.516376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:24.691348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363621b5-af0b-47bb-881f-8d85cfe42853 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:24.705470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363621b5-af0b-47bb-881f-8d85cfe42853 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:24.710876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:24.722978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:24.722978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:24.722978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:24.722978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:24.722978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ebac1-78db-442c-b157-164b19425328 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:24.732281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 706/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:25.685896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e0c-4c4a-4b07-a846-65723c808d13 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:25.686468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e0c-4c4a-4b07-a846-65723c808d13 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:25.686468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e0c-4c4a-4b07-a846-65723c808d13 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:25.687847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:25.693181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4706bf-934b-43c3-97f6-3f44f18bf51a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:25.693625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4706bf-934b-43c3-97f6-3f44f18bf51a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:25.693783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4706bf-934b-43c3-97f6-3f44f18bf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:25.711456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8e4706bf-934b-43c3-97f6-3f44f18bf51a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:25.712734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8e4706bf-934b-43c3-97f6-3f44f18bf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:25.720979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:25.871299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8e0c-4c4a-4b07-a846-65723c808d13 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:25.885728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8e0c-4c4a-4b07-a846-65723c808d13 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:25.891784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:25.892419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:25.892741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:25.893029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:25.901042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:25.902897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bc952-9b1a-451d-847f-f56dfc768f9c service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:25.912135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 715/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:26.853295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8eb6-85ea-42b9-9686-cbe7c09d9713 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:26.853818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8eb6-85ea-42b9-9686-cbe7c09d9713 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:26.853912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8eb6-85ea-42b9-9686-cbe7c09d9713 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:26.855277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:26.861093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5164544-1658-4a54-8a41-a8606683f49c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:26.861502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5164544-1658-4a54-8a41-a8606683f49c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:26.861669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5164544-1658-4a54-8a41-a8606683f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:26.879990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b5164544-1658-4a54-8a41-a8606683f49c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:26.881225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b5164544-1658-4a54-8a41-a8606683f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:26.889064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:27.050215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8eb6-85ea-42b9-9686-cbe7c09d9713 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:27.064829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8eb6-85ea-42b9-9686-cbe7c09d9713 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:27.070269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:27.070906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:27.071190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:27.071463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:27.080240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:27.081853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597ac2-4280-4ef5-9053-22238e3a40ee service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:27.092049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 709/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:28.023656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf8ac-c5c6-4da5-875c-ad7a36f30d39 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:28.024280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf8ac-c5c6-4da5-875c-ad7a36f30d39 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:28.024280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaf8ac-c5c6-4da5-875c-ad7a36f30d39 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:28.025551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:28.031444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76cc-51c0-4dea-979b-322c7b0f3621 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:28.031886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76cc-51c0-4dea-979b-322c7b0f3621 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:28.032019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76cc-51c0-4dea-979b-322c7b0f3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:28.050523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-324a76cc-51c0-4dea-979b-322c7b0f3621 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:28.051763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-324a76cc-51c0-4dea-979b-322c7b0f3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:28.059646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:28.211147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaf8ac-c5c6-4da5-875c-ad7a36f30d39 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:28.225898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaf8ac-c5c6-4da5-875c-ad7a36f30d39 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:28.231456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:28.232897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:28.233187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:28.233470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:28.242126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:28.243708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663bc1-eae1-403f-a806-24f7ce853a1c service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:28.253087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 718/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:29.175713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa58-8d7b-4290-bd0e-40c66a1587db None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:29.176308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa58-8d7b-4290-bd0e-40c66a1587db None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:29.176544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa58-8d7b-4290-bd0e-40c66a1587db None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:29.178004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:29.183620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d75bd2-5b09-455c-990b-3cef01c55d3b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:29.184046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d75bd2-5b09-455c-990b-3cef01c55d3b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:29.184191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d75bd2-5b09-455c-990b-3cef01c55d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:29.203385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-68d75bd2-5b09-455c-990b-3cef01c55d3b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:29.204590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-68d75bd2-5b09-455c-990b-3cef01c55d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:29.212390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:29.368457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fa58-8d7b-4290-bd0e-40c66a1587db None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:29.383295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fa58-8d7b-4290-bd0e-40c66a1587db None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:29.389136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:29.389771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:29.390058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:29.390341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:29.398293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:29.399904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161a35-49dc-4a56-a281-253472e14d0b service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:29.410602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 712/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:30.316516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04e7b-df09-43d3-83d1-695cb8505ec5 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:30.317069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04e7b-df09-43d3-83d1-695cb8505ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:30.317186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04e7b-df09-43d3-83d1-695cb8505ec5 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:30.318559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:30.323468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dec0-d7f9-41cb-a0d7-726110b1d611 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:30.323869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dec0-d7f9-41cb-a0d7-726110b1d611 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:30.324031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dec0-d7f9-41cb-a0d7-726110b1d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:30.343871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3cb8dec0-d7f9-41cb-a0d7-726110b1d611 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:30.345102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3cb8dec0-d7f9-41cb-a0d7-726110b1d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:30.352755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:30.500704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be04e7b-df09-43d3-83d1-695cb8505ec5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:30.514921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be04e7b-df09-43d3-83d1-695cb8505ec5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:30.520330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:30.520999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:30.521288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:30.521569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:30.530520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:30.532094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e7e24-ebdd-42e3-b746-189ab815fbef service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:30.546499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 721/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:31.471555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b4156-21a6-49ee-804c-b30d6023d7a1 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:31.472101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b4156-21a6-49ee-804c-b30d6023d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:31.472101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b4156-21a6-49ee-804c-b30d6023d7a1 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:31.473575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:31.478945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c669-7c86-4fbc-a1a8-0d9cbd37aad8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:31.479379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c669-7c86-4fbc-a1a8-0d9cbd37aad8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:31.479506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c669-7c86-4fbc-a1a8-0d9cbd37aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:31.499370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fce0c669-7c86-4fbc-a1a8-0d9cbd37aad8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:31.500574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fce0c669-7c86-4fbc-a1a8-0d9cbd37aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:31.508374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:31.664358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b4156-21a6-49ee-804c-b30d6023d7a1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:31.679222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b4156-21a6-49ee-804c-b30d6023d7a1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:31.685583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:31.686237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:31.686529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:31.686812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:31.694829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:31.696462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea674d1-fab2-412d-8f64-f7260119e730 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:31.706263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 715/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:32.592802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f62f49-b817-4f29-b3cf-791cf8b1a1d0 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:32.593336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f62f49-b817-4f29-b3cf-791cf8b1a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:32.593336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f62f49-b817-4f29-b3cf-791cf8b1a1d0 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:32.594663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:32.599538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5cee-5b8b-4fb1-b2bd-bfc843e63b17 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:32.599954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5cee-5b8b-4fb1-b2bd-bfc843e63b17 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:32.600105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5cee-5b8b-4fb1-b2bd-bfc843e63b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:32.618280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-364c5cee-5b8b-4fb1-b2bd-bfc843e63b17 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:32.619479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-364c5cee-5b8b-4fb1-b2bd-bfc843e63b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:32.627306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:32.775303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f62f49-b817-4f29-b3cf-791cf8b1a1d0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:32.789621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f62f49-b817-4f29-b3cf-791cf8b1a1d0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:32.794930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:32.795561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:32.795849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:32.796127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:32.804070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:32.805688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434230da-0fbd-4939-b3b6-6b2067f0b245 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:32.815457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 724/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:34.996778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252756-9ad9-43c1-9c2b-e0e91288daa6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:34.997944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252756-9ad9-43c1-9c2b-e0e91288daa6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:34.998208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252756-9ad9-43c1-9c2b-e0e91288daa6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:34.999413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:35.004837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1a6-c5e4-47b8-986b-bc1066554c5a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:35.005276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1a6-c5e4-47b8-986b-bc1066554c5a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:35.005386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1a6-c5e4-47b8-986b-bc1066554c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:35.023399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6c26a1a6-c5e4-47b8-986b-bc1066554c5a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:35.024603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6c26a1a6-c5e4-47b8-986b-bc1066554c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:35.032714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:35.070762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252756-9ad9-43c1-9c2b-e0e91288daa6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:35.082015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252756-9ad9-43c1-9c2b-e0e91288daa6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:35.085515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:35.086152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:35.086439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:35.086715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:35.095613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:35.102400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0dd93-7478-444c-ac51-65e0ae511256 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:35.106951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 718/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:37.618265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584c75-28fc-4858-a790-048c0b6e376e None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:37.618834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584c75-28fc-4858-a790-048c0b6e376e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:37.618834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584c75-28fc-4858-a790-048c0b6e376e None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:37.620179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:37.626615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79f6b-f07f-439b-9697-8fadeb3d292f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:37.627013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79f6b-f07f-439b-9697-8fadeb3d292f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:37.627197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79f6b-f07f-439b-9697-8fadeb3d292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:37.645018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-31f79f6b-f07f-439b-9697-8fadeb3d292f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:37.646214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-31f79f6b-f07f-439b-9697-8fadeb3d292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:37.654486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:37.693765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08584c75-28fc-4858-a790-048c0b6e376e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:37.704330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08584c75-28fc-4858-a790-048c0b6e376e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:37.707783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:37.708415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:37.708740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:37.709020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:37.718275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:37.719690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1ad9-1951-4e7a-8126-00d42320e4a6 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:37.728881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 727/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:40.349729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c95e-0a19-48e5-9faf-e23a9dff9bbb None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:40.350290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c95e-0a19-48e5-9faf-e23a9dff9bbb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:40.350290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c95e-0a19-48e5-9faf-e23a9dff9bbb None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:40.351671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:40.356971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779718-d0b4-4c55-9432-53f3390e832d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:40.357423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779718-d0b4-4c55-9432-53f3390e832d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:40.357533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779718-d0b4-4c55-9432-53f3390e832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:40.375023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3d779718-d0b4-4c55-9432-53f3390e832d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:40.376233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3d779718-d0b4-4c55-9432-53f3390e832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:40.383982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:40.423353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402c95e-0a19-48e5-9faf-e23a9dff9bbb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:40.433886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402c95e-0a19-48e5-9faf-e23a9dff9bbb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:40.437616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:40.438249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:40.438532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:40.438814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:40.447494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:40.448959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278828c-506b-4073-8cb2-9260f1b9eec4 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:40.458939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 721/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:42.787370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728161-604a-4815-90c3-144f092a56e1 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.787849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728161-604a-4815-90c3-144f092a56e1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.787960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728161-604a-4815-90c3-144f092a56e1 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.789375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:42.795189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471862-6fed-4255-980b-25f593d10e51 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.795607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471862-6fed-4255-980b-25f593d10e51 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.795747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471862-6fed-4255-980b-25f593d10e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.813837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fb471862-6fed-4255-980b-25f593d10e51 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:42.815026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fb471862-6fed-4255-980b-25f593d10e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:42.822672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:42.860779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728161-604a-4815-90c3-144f092a56e1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.871298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728161-604a-4815-90c3-144f092a56e1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.875983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.876628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.876930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.877212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.886039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.888025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220d312-48eb-4cba-b3c2-6becb232fc0f service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.897373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 730/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:45.198129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6550-25ec-4cc2-98ad-a1fe4373529b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:45.198757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6550-25ec-4cc2-98ad-a1fe4373529b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:45.198757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6550-25ec-4cc2-98ad-a1fe4373529b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:45.200104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:45.205760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683714f1-e6e0-4121-9223-6fd706c979bb None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:45.206212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683714f1-e6e0-4121-9223-6fd706c979bb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:45.206327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683714f1-e6e0-4121-9223-6fd706c979bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:45.224876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-683714f1-e6e0-4121-9223-6fd706c979bb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:45.226075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-683714f1-e6e0-4121-9223-6fd706c979bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:45.234774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:45.271599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6550-25ec-4cc2-98ad-a1fe4373529b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:45.287529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6550-25ec-4cc2-98ad-a1fe4373529b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:45.291043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:45.291688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:45.291975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:45.292476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:45.302686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:45.308730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415dc1c-8971-4e4c-922f-8bf1fa0405a7 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:45.313634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 724/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:47.651108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:47.651662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:47.651783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:47.654113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:47.659461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda57fb0-8db7-41c5-993e-39f3ee0b2537 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:47.659894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda57fb0-8db7-41c5-993e-39f3ee0b2537 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:47.660105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda57fb0-8db7-41c5-993e-39f3ee0b2537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:47.678705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bda57fb0-8db7-41c5-993e-39f3ee0b2537 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:47.679904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bda57fb0-8db7-41c5-993e-39f3ee0b2537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:47.688017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:47.726225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:47.727875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:47.741698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78b43-eb97-4957-8cce-855edd946e1a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:47.745130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:47.745757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:47.746041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:47.746350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:47.755158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:47.756558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315935fe-b4c7-4dcd-b6db-e3de2bbaccd1 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:47.765916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 733/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:50.178437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144f66-d48c-49a3-96f2-8524135a7725 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:50.179010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144f66-d48c-49a3-96f2-8524135a7725 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:50.179010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144f66-d48c-49a3-96f2-8524135a7725 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:50.180395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:50.186055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd6f0-cc63-427b-bc52-2d8555c83de2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:50.192695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd6f0-cc63-427b-bc52-2d8555c83de2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:50.192695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd6f0-cc63-427b-bc52-2d8555c83de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:50.192695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=70 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:50.204781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d27cd6f0-cc63-427b-bc52-2d8555c83de2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:50.205966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d27cd6f0-cc63-427b-bc52-2d8555c83de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:50.213826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:50.250907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144f66-d48c-49a3-96f2-8524135a7725 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:50.256349 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=73 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:50.262986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144f66-d48c-49a3-96f2-8524135a7725 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:50.266610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:50.267250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:50.267538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:50.267819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:50.276799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:50.279323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a737-38d8-46fc-b961-18a338bd04a8 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:50.288775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 727/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:52.623875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd1d6-ece1-48fc-a99d-e091316e6289 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.624403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd1d6-ece1-48fc-a99d-e091316e6289 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.624517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd1d6-ece1-48fc-a99d-e091316e6289 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.625923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:52.631200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e9ab8-c819-489f-92d3-bb1ac772051b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.631628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e9ab8-c819-489f-92d3-bb1ac772051b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.631765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e9ab8-c819-489f-92d3-bb1ac772051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.649338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b13e9ab8-c819-489f-92d3-bb1ac772051b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:52.650517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b13e9ab8-c819-489f-92d3-bb1ac772051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:52.658513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:52.695467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd1d6-ece1-48fc-a99d-e091316e6289 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:52.706283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd1d6-ece1-48fc-a99d-e091316e6289 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:52.709735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:52.710365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.710648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.710923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.720405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:52.721858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc516ba-6c52-436e-8c77-76bf6297ab8c service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:52.731912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 736/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:55.011997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44297c6-5493-403e-9557-41eadbd1bb0e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:55.013817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44297c6-5493-403e-9557-41eadbd1bb0e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:55.013817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44297c6-5493-403e-9557-41eadbd1bb0e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:55.014027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:55.019439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d088aed-2d87-45e3-911b-1bc67c717ffa None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:55.019854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d088aed-2d87-45e3-911b-1bc67c717ffa None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:55.020013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d088aed-2d87-45e3-911b-1bc67c717ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:55.038225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8d088aed-2d87-45e3-911b-1bc67c717ffa None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:55.039420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8d088aed-2d87-45e3-911b-1bc67c717ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:55.047916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:55.083505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44297c6-5493-403e-9557-41eadbd1bb0e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:55.094760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44297c6-5493-403e-9557-41eadbd1bb0e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:55.098327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:55.101734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:55.101734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:55.101734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:55.109293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:55.110841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201250a8-dd72-4c2a-9ccd-5a61947f6257 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:55.120825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 730/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:57.365041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db92cb-d431-4d13-8e55-464daa4df21f None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:57.365617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db92cb-d431-4d13-8e55-464daa4df21f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:57.365617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db92cb-d431-4d13-8e55-464daa4df21f None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:57.366974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:51:57.372693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4546-3766-4cc7-97b4-27e9672c0e47 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:57.373148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4546-3766-4cc7-97b4-27e9672c0e47 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:57.373253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4546-3766-4cc7-97b4-27e9672c0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:57.391556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f12c4546-3766-4cc7-97b4-27e9672c0e47 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:57.392783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f12c4546-3766-4cc7-97b4-27e9672c0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:57.400821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:57.440703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db92cb-d431-4d13-8e55-464daa4df21f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:57.452021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db92cb-d431-4d13-8e55-464daa4df21f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:57.455525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:57.456161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:57.456447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:57.456768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:57.466128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:57.467562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5a88f-339c-4165-9c68-d2852ba8673b service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:57.477049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 739/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:07.385557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=17 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:07.472843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=17 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:31.088525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808d62-64dc-4dce-94bb-517c9d95910b None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:31.088525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808d62-64dc-4dce-94bb-517c9d95910b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:31.089225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808d62-64dc-4dce-94bb-517c9d95910b None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:31.090212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 732/1471] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:31.095317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb1c6-14f0-4bb5-be14-bc9e1c055182 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:31.100998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb1c6-14f0-4bb5-be14-bc9e1c055182 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:31.100998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb1c6-14f0-4bb5-be14-bc9e1c055182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:31.113374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ecccb1c6-14f0-4bb5-be14-bc9e1c055182 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:31.114584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ecccb1c6-14f0-4bb5-be14-bc9e1c055182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:31.123202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 740/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:31.170738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c54b-7e5e-4f17-9bc8-d570584049e2 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:31.171034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c54b-7e5e-4f17-9bc8-d570584049e2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:31.171312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c54b-7e5e-4f17-9bc8-d570584049e2 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:31.172741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 733/1473] 10.222.0.57 () {54 vars in 962 bytes} [Wed May 25 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:31.177604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0f9e-b74f-46a0-9bda-74bfdacd3e75 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:31.177931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0f9e-b74f-46a0-9bda-74bfdacd3e75 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:31.178221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0f9e-b74f-46a0-9bda-74bfdacd3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:31.196796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b97a0f9e-b74f-46a0-9bda-74bfdacd3e75 None None] MFA Rules not processed for user `9548a1d963a644559c769715d0d58c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:31.198586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b97a0f9e-b74f-46a0-9bda-74bfdacd3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:31.205148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 741/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Wed May 25 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:31.212284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c54b-7e5e-4f17-9bc8-d570584049e2 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:31.223811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c54b-7e5e-4f17-9bc8-d570584049e2 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:31.227499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:31.228137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:31.228428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:31.228744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:31.238018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:31.239461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d17b-a8b6-4ba0-b1f7-a3a219f7afc6 service glance] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:31.249587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 734/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:33.575627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b6f2-d1c5-46a6-923e-6da8998a3d81 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:33.576166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b6f2-d1c5-46a6-923e-6da8998a3d81 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:33.576166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b6f2-d1c5-46a6-923e-6da8998a3d81 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:33.577506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 742/1476] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:33.582647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d631c2-d898-475b-b89d-6620b153b03e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:33.583096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d631c2-d898-475b-b89d-6620b153b03e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:33.583222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d631c2-d898-475b-b89d-6620b153b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:33.600893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-33d631c2-d898-475b-b89d-6620b153b03e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:33.602092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-33d631c2-d898-475b-b89d-6620b153b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:33.610733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 735/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:33.633874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b6f2-d1c5-46a6-923e-6da8998a3d81 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:33.646539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b6f2-d1c5-46a6-923e-6da8998a3d81 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:33.651407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:33.652105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:33.652399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:33.652719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:33.653459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:33.655332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:52:33.655332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:52:33.655332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:52:33.656496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b743-b5f9-464b-9eec-95846701a154 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:33.675901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 743/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Wed May 25 14:52:33 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:35.880704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664f8a-cad2-4f1d-9194-b5ca83327d26 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:35.881272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664f8a-cad2-4f1d-9194-b5ca83327d26 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:35.881272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664f8a-cad2-4f1d-9194-b5ca83327d26 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:35.882651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 736/1479] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:35.889774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb8f8-125f-4525-bbd7-61ccb696718b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:35.890177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb8f8-125f-4525-bbd7-61ccb696718b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:35.890349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb8f8-125f-4525-bbd7-61ccb696718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:35.908686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-96adb8f8-125f-4525-bbd7-61ccb696718b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:35.909880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-96adb8f8-125f-4525-bbd7-61ccb696718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:35.918072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 744/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:35.961210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664f8a-cad2-4f1d-9194-b5ca83327d26 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:35.976515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664f8a-cad2-4f1d-9194-b5ca83327d26 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:35.982070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:35.982712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:35.982984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:35.983267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:35.991564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:35.993180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971294c0-77c4-4dd4-80e0-1a4f009073b9 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:36.002866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 737/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:38.397391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc73d-7bcc-492e-a8ef-36f8b6b84675 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:38.397936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc73d-7bcc-492e-a8ef-36f8b6b84675 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:38.398056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc73d-7bcc-492e-a8ef-36f8b6b84675 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:38.399365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 745/1482] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:38.405366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddf4c4-c0b1-466b-afec-ffe99b170404 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:38.405767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddf4c4-c0b1-466b-afec-ffe99b170404 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:38.405939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddf4c4-c0b1-466b-afec-ffe99b170404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:38.423377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-56ddf4c4-c0b1-466b-afec-ffe99b170404 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:38.426187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-56ddf4c4-c0b1-466b-afec-ffe99b170404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:38.433067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 738/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:38.469716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcc73d-7bcc-492e-a8ef-36f8b6b84675 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:38.480698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcc73d-7bcc-492e-a8ef-36f8b6b84675 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:38.484109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:38.484792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:38.485076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:38.485353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:38.495254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:38.496718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b523285-7524-4885-8115-4f3c35201b41 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:38.506380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 746/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:52:40.815387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3bac1-4e98-44d3-9f24-259d8746508c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:40.815914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3bac1-4e98-44d3-9f24-259d8746508c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:40.816018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3bac1-4e98-44d3-9f24-259d8746508c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:40.817373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 739/1485] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:40.823406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c49d-d560-4a09-a6de-f687f3ce761a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:40.823828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c49d-d560-4a09-a6de-f687f3ce761a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:40.823939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c49d-d560-4a09-a6de-f687f3ce761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:40.841426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ebd2c49d-d560-4a09-a6de-f687f3ce761a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:40.842614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ebd2c49d-d560-4a09-a6de-f687f3ce761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:40.850309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 747/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:40.889089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3bac1-4e98-44d3-9f24-259d8746508c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:40.899712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3bac1-4e98-44d3-9f24-259d8746508c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:40.904540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:40.905260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:40.905548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:40.905853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:40.915107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:40.916553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11f80-c506-44e4-8018-f49a0be30c8c service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:40.925972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 740/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:43.285996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df439-2eca-4a42-ae07-ea3e7c93ae0a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:43.286528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df439-2eca-4a42-ae07-ea3e7c93ae0a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:43.286659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df439-2eca-4a42-ae07-ea3e7c93ae0a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:43.287935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 748/1488] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:43.293826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e294-3e30-4078-bbd7-1eb6996708cb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:43.294240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e294-3e30-4078-bbd7-1eb6996708cb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:43.294426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e294-3e30-4078-bbd7-1eb6996708cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:43.312130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e816e294-3e30-4078-bbd7-1eb6996708cb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:43.313346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e816e294-3e30-4078-bbd7-1eb6996708cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:43.320944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 741/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:43.360941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df439-2eca-4a42-ae07-ea3e7c93ae0a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:43.371460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df439-2eca-4a42-ae07-ea3e7c93ae0a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:43.374936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:43.375565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:43.375851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:43.376131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:43.385393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:43.386799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424aeb9-5570-479b-b00e-ce659bbda486 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:43.396009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 749/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:46.071137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88e98-b465-4748-ab34-135b39b486b3 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:46.071756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88e98-b465-4748-ab34-135b39b486b3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:46.071756 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88e98-b465-4748-ab34-135b39b486b3 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:46.073822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 742/1491] 10.222.0.57 () {54 vars in 926 bytes} [Wed May 25 14:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:52:46.079136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6458-f5d3-4159-b8a9-c1d8ff70e9a2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:46.079598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6458-f5d3-4159-b8a9-c1d8ff70e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:46.079700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6458-f5d3-4159-b8a9-c1d8ff70e9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:46.097281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5d1c6458-f5d3-4159-b8a9-c1d8ff70e9a2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:46.098478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5d1c6458-f5d3-4159-b8a9-c1d8ff70e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:46.106789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 750/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Wed May 25 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:46.145797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88e98-b465-4748-ab34-135b39b486b3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:46.157718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88e98-b465-4748-ab34-135b39b486b3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:46.161334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:46.161979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:46.162263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:46.162545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:46.173115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:46.208970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ee547-7d41-4885-a4a2-9fdc2ac4afba service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:46.208970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 743/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:52:56.092069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=33 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:56.180465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=33 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:51.410350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.410933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.410933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.430398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:51.431610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:51.439766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 751/1494] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:51.449145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.449644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.449747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.467760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:51.468962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:51.477226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 744/1495] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:51.481613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.491100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66889-c48a-4ef5-8c4b-e0a4a6fba2d5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.495592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.496242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.496526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.496844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.497563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:54:51.497869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.498865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.498865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:54:51.498865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:54:51.499749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.511901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 752/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:54:51.519978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.529825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e4f24-7697-45dc-88ea-5c604cf5b766 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.534249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.534893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.535179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.535458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.536139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.537949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.537949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:54:51.537949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:54:51.539188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.673244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 745/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:54:51 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:54:51.677553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.687488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205af2-e0da-488b-a564-7674d411276b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.743964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.744560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.744880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.745158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.745843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.746847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.746847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:54:51.746847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:54:51.748050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.822966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 753/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:54:51 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:54:51.827318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.838375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c028d-5201-4cdf-b8a9-6d5d381856e7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.842968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.843631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.843952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.844237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.845003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.846025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.846025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:54:51.846025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:54:51.846914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.859900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 746/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:54:51.863804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.874095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5b06-8c01-431b-9994-3d22ca7f94f1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.878595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.879272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.879560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.879842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.880565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.881687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.881687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:54:51.881687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:54:51.883160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5795dc3-5033-48b3-8037-359c8e16644c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.896233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 754/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:54:51.900728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:51.910380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba44d-6345-46cf-9a19-a4295f9bceeb admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:51.915006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:51.915867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:51.916150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:51.916424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] PATH_INFO: `/v3/projects/0bac19cb74834d7fb63c4c958e28714f/users/540663763a9c43e7b0599c53b52dbe17/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:51.932263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bac19cb74834d7fb63c4c958e28714f, user_id=540663763a9c43e7b0599c53b52dbe17, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:51.933363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:51.933363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:54:51.933363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:54:51.935289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7dba-05f9-459a-9cd9-5157ae0b69f1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:51.992503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 747/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:54:51 2022] PUT /identity/v3/projects/0bac19cb74834d7fb63c4c958e28714f/users/540663763a9c43e7b0599c53b52dbe17/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:54:52.003888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6418-4112-49ff-a8d5-3897dc458f7d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.004129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6418-4112-49ff-a8d5-3897dc458f7d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.004416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6418-4112-49ff-a8d5-3897dc458f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.032110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f1cc6418-4112-49ff-a8d5-3897dc458f7d None None] MFA Rules not processed for user `540663763a9c43e7b0599c53b52dbe17`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:52.033361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f1cc6418-4112-49ff-a8d5-3897dc458f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:52.103461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 755/1502] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:52.117565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed457a-20a3-4387-975f-ace61fff4dca None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.117861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed457a-20a3-4387-975f-ace61fff4dca None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.118147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed457a-20a3-4387-975f-ace61fff4dca None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.119565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 748/1503] 10.222.0.57 () {54 vars in 963 bytes} [Wed May 25 14:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:54:52.124387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a33f-d5bd-4833-84b2-4c33d864b4d3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.124709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a33f-d5bd-4833-84b2-4c33d864b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.124996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a33f-d5bd-4833-84b2-4c33d864b4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.143237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3295a33f-d5bd-4833-84b2-4c33d864b4d3 None None] MFA Rules not processed for user `d6d25014e11e4765b66fc04586547473`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:52.144419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3295a33f-d5bd-4833-84b2-4c33d864b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:52.187815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:52.195469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 756/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Wed May 25 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:54:52.203722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed457a-20a3-4387-975f-ace61fff4dca None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:52.215084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed457a-20a3-4387-975f-ace61fff4dca None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:52.218711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:52.219353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.219637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.219936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.228512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:52.229963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:52.238997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 749/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:52.285960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dffc2-f683-4558-ae02-6b956080b5cb None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.286260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dffc2-f683-4558-ae02-6b956080b5cb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.286545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dffc2-f683-4558-ae02-6b956080b5cb None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.288341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 757/1506] 10.222.0.57 () {52 vars in 829 bytes} [Wed May 25 14:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:52.292720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:52.356807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a93f-0967-4611-9b83-6b90e01b42d7 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:52.361290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:52.362155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.362440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.362716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] PATH_INFO: `/v3/users/540663763a9c43e7b0599c53b52dbe17` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.363895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540663763a9c43e7b0599c53b52dbe17)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:52.364942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:52.364942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:54:52.364942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:54:52.366981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:52.589724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540663763a9c43e7b0599c53b52dbe17'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:52.609414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540663763a9c43e7b0599c53b52dbe17'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:52.610244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540663763a9c43e7b0599c53b52dbe17'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:52.610857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540663763a9c43e7b0599c53b52dbe17'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:52.673327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540663763a9c43e7b0599c53b52dbe17'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:52.682287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:52.691981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 750/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:54:52 2022] DELETE /identity/v3/users/540663763a9c43e7b0599c53b52dbe17 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:54:52.696649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.697158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.697294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.715254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:52.716443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:52.776859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 758/1508] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:52.786267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:52.787643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:52.844211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72be82-c38f-4722-9fb3-8e844259b7b4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:52.847670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:52.848317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.848687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.848918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.858118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:52.859661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058bfc9-3878-49d0-991f-304123c1e6dd service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:52.869873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 751/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:53.315660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:53.317166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:53.330127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed62a-a577-43f7-80ce-582ba0829d94 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:53.336206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:53.337161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:53.337451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:53.337732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] PATH_INFO: `/v3/projects/0bac19cb74834d7fb63c4c958e28714f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:53.339004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bac19cb74834d7fb63c4c958e28714f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:53.340028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:53.340028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:54:53.340028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:54:53.341316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:53.477174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bac19cb74834d7fb63c4c958e28714f', 'request_id': 'req-136c4ab5-63ad-451a-afa0-21cb4bc40d04'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:53.554500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bac19cb74834d7fb63c4c958e28714f', 'request_id': 'req-136c4ab5-63ad-451a-afa0-21cb4bc40d04'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:53.568313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bac19cb74834d7fb63c4c958e28714f', 'request_id': 'req-136c4ab5-63ad-451a-afa0-21cb4bc40d04'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:53.579707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] The token cache is being invalidate because project 0bac19cb74834d7fb63c4c958e28714f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:54:53.579996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:53.580796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-136c4ab5-63ad-451a-afa0-21cb4bc40d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:54:53.582373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 759/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:54:53 2022] DELETE /identity/v3/projects/0bac19cb74834d7fb63c4c958e28714f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:55:02.864910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=29 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:03.576789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:41.585772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:41.586357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:41.586357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:41.587638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:41.593979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e477-25c5-466a-823a-901467e425fd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:41.594801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e477-25c5-466a-823a-901467e425fd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:41.594801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e477-25c5-466a-823a-901467e425fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:41.615800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5706e477-25c5-466a-823a-901467e425fd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:41.617076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5706e477-25c5-466a-823a-901467e425fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:41.681469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:41.858081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:41.859990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:41.943101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de863bf-70d7-4d5f-9b7c-bb9054bf916a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:41.948903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:41.949575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:41.950410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:41.950690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:41.960146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:41.961787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c9223-0e9e-4cde-bab6-ab6dc0986a55 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:41.972474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 753/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:42.879260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77795c-d52b-4507-8b06-a787cb1d153a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:42.879838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77795c-d52b-4507-8b06-a787cb1d153a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:42.879838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77795c-d52b-4507-8b06-a787cb1d153a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:42.881262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:42.886126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a23-35b9-41d2-8dc0-f589cc6207c4 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:42.886597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a23-35b9-41d2-8dc0-f589cc6207c4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:42.886707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985a23-35b9-41d2-8dc0-f589cc6207c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:42.908323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-76985a23-35b9-41d2-8dc0-f589cc6207c4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:42.910683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-76985a23-35b9-41d2-8dc0-f589cc6207c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:42.919963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:43.074056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77795c-d52b-4507-8b06-a787cb1d153a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:43.089762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77795c-d52b-4507-8b06-a787cb1d153a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:43.095907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:43.096567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:43.096893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:43.097172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:43.106552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:43.108282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32584a67-2b1a-4ec1-a97d-a563c76ac43e service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:43.119520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 762/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:43.772434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7796bd-1955-418f-8b30-b930941519ee None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:43.772747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7796bd-1955-418f-8b30-b930941519ee None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:43.773030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7796bd-1955-418f-8b30-b930941519ee None None] PATH_INFO: `/v3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:43.774361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 755/1517] 10.222.0.90 () {54 vars in 925 bytes} [Wed May 25 14:56:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:56:43.782227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce4b7-7cb1-46a9-8e2b-59f1b3c644fd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:43.782683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce4b7-7cb1-46a9-8e2b-59f1b3c644fd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:43.783065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce4b7-7cb1-46a9-8e2b-59f1b3c644fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:43.802365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f48ce4b7-7cb1-46a9-8e2b-59f1b3c644fd None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:43.803594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f48ce4b7-7cb1-46a9-8e2b-59f1b3c644fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:43.872991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 763/1518] 10.222.0.90 () {58 vars in 1015 bytes} [Wed May 25 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:52.901056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=37 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:53.863082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=62 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:54.421359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a9dc-0c86-4b99-a322-b6bffca815a5 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:54.421936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a9dc-0c86-4b99-a322-b6bffca815a5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:54.422044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a9dc-0c86-4b99-a322-b6bffca815a5 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:54.423436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 756/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:54.428530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903633e9-b29c-4e24-959c-3d6af26485a7 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:54.428940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903633e9-b29c-4e24-959c-3d6af26485a7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:54.429227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903633e9-b29c-4e24-959c-3d6af26485a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:54.447465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-903633e9-b29c-4e24-959c-3d6af26485a7 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:54.448685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-903633e9-b29c-4e24-959c-3d6af26485a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:54.456910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 764/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:54.612748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4a9dc-0c86-4b99-a322-b6bffca815a5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:54.627856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4a9dc-0c86-4b99-a322-b6bffca815a5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:54.633150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:54.633797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:54.634081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:54.634363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:54.644321 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:54.646119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8be2c-d586-428b-a80e-d7847e601182 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:54.657498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 757/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:55.325890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbe83-e70b-4f8d-a3aa-b0cd8fc7631a None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.327259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbe83-e70b-4f8d-a3aa-b0cd8fc7631a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.327259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbe83-e70b-4f8d-a3aa-b0cd8fc7631a None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.328714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 765/1522] 10.222.0.57 () {54 vars in 960 bytes} [Wed May 25 14:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:55.334033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d3a7-09c5-440a-a0ac-42464f73d671 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.334399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d3a7-09c5-440a-a0ac-42464f73d671 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.334750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d3a7-09c5-440a-a0ac-42464f73d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.353283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-85c4d3a7-09c5-440a-a0ac-42464f73d671 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:55.354597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-85c4d3a7-09c5-440a-a0ac-42464f73d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:55.364409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 758/1523] 10.222.0.57 () {58 vars in 1057 bytes} [Wed May 25 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:55.371851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fbe83-e70b-4f8d-a3aa-b0cd8fc7631a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:55.386058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fbe83-e70b-4f8d-a3aa-b0cd8fc7631a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:55.391874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:55.392514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.392825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.393105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.402205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:55.403791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8ed5-c7b1-4b82-b714-24f83db40ff2 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:55.414189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 766/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:55.542951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d002d-884b-46aa-971b-677b452a4dac None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.543496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d002d-884b-46aa-971b-677b452a4dac None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.543496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d002d-884b-46aa-971b-677b452a4dac None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.545414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:55.550632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0b2d-3e2b-46f6-8e3d-a97c06748fd5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.550933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0b2d-3e2b-46f6-8e3d-a97c06748fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.551225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0b2d-3e2b-46f6-8e3d-a97c06748fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.570283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-baaa0b2d-3e2b-46f6-8e3d-a97c06748fd5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:55.571483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-baaa0b2d-3e2b-46f6-8e3d-a97c06748fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:55.580665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:56:55.733177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d002d-884b-46aa-971b-677b452a4dac None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:55.756842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d002d-884b-46aa-971b-677b452a4dac None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:55.762262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:55.762910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:55.763192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:55.763468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:55.773817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:55.775398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0850c7d-116f-4335-b8d3-a8a10bf86a90 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:55.785983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 760/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:57:00.011141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:00.011712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:00.011712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:00.013116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:57:00.018613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960fb61-8310-480f-98c4-949ffb1b99f0 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:00.019307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960fb61-8310-480f-98c4-949ffb1b99f0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:00.019449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960fb61-8310-480f-98c4-949ffb1b99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:00.038463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6960fb61-8310-480f-98c4-949ffb1b99f0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:57:00.039706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6960fb61-8310-480f-98c4-949ffb1b99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:00.048330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:57:00.086222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:57:00.087918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:00.148251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ba13-8a49-458f-bafc-1695e08cf42d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:57:00.151843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:57:00.152497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:00.152816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:00.153102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:00.162709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:57:00.164154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664570c-9b81-4195-96a9-bc45c4f2d3f8 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:57:00.174579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 769/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:57:02.453506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:02.454070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:02.454168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:02.455498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:57:02.460848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbcdc-9b40-43ac-bd76-94ccb7e10497 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:02.461291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbcdc-9b40-43ac-bd76-94ccb7e10497 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:02.461397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbcdc-9b40-43ac-bd76-94ccb7e10497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:02.479711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0cfdbcdc-9b40-43ac-bd76-94ccb7e10497 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:57:02.480963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0cfdbcdc-9b40-43ac-bd76-94ccb7e10497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:02.494101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:57:02.527016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:57:02.528773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:02.556105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd6ed-a7d2-48bf-90d6-b33255ecad36 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:57:02.559901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:57:02.560597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:02.560943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:02.561222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:02.571274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:57:02.572817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d34bd-3b4c-423c-999b-7b96bdd3826a service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:57:02.584101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 763/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:57:06.452414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:06.453763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:06.455499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:06.457954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:57:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:57:06.463578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5dec1-f05d-4549-85ed-f9eb11c33173 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:06.464076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5dec1-f05d-4549-85ed-f9eb11c33173 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:06.464226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5dec1-f05d-4549-85ed-f9eb11c33173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:06.485571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f5e5dec1-f05d-4549-85ed-f9eb11c33173 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:57:06.486789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f5e5dec1-f05d-4549-85ed-f9eb11c33173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:06.494634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:57:06.773832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:57:06.777799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:06.838141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0192-ce05-4c07-b17d-a1c69ec318af None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:57:06.842529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:57:06.843218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:06.843506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:06.843785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:06.853249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:57:06.854700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c0a0-5695-49dd-94d4-aafa03b4ad56 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:57:06.864911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 772/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:57:09.176365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:09.176931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:09.177025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:09.178378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:57:09.183940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0e46-cc88-4c2f-9bed-dca0978c3d52 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:09.184396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0e46-cc88-4c2f-9bed-dca0978c3d52 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:09.184572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa0e46-cc88-4c2f-9bed-dca0978c3d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:09.203256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-08fa0e46-cc88-4c2f-9bed-dca0978c3d52 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:57:09.204420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-08fa0e46-cc88-4c2f-9bed-dca0978c3d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:09.212680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:57:09.504294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:57:09.506049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:57:09.520070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1a2f-b22c-4b03-8f29-98149321a81e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:57:09.523630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:57:09.524277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:57:09.524565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:57:09.524876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:57:09.534709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:57:09.536201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42ef0f-2ef3-439f-8ff2-592daf8187b0 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:57:09.547733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 766/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:57:19.197370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=70 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:19.542103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=33 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:45.564667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.565257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.565257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.592491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:45.594036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:45.603883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 774/1540] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:45.614403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.614991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.614991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.640709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:45.640709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:45.655592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 767/1541] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:45.660998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:45.672561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592e4a6-5ce3-4f5b-9c5b-936d4d52abe5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:45.678303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:45.678999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.679288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.679572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.680318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:45.680652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:45.682520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc4b-b387-46d7-991a-b1988a67dca3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:45.701865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 775/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:45.710382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:45.716466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ffb5-36ef-44ce-97de-405f1814fc1b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.716781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ffb5-36ef-44ce-97de-405f1814fc1b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.717142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ffb5-36ef-44ce-97de-405f1814fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.722034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1ed4f-7e1d-4576-a62c-6f6627cafb2d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:45.741721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:45.742431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.742723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.743026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.743884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:45.747585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:45.749743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3e75ffb5-36ef-44ce-97de-405f1814fc1b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:45.751662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3e75ffb5-36ef-44ce-97de-405f1814fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:45.764404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 776/1543] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:45.784963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.788155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.788155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.817450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:45.818657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:45.828016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 777/1544] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:45.834003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:45.848270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae38f4-0b19-4b1e-b953-2fb4cd8516cc None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:45.853884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:45.854664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:45.854953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:45.855233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:45.855974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:45.856286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:45.857983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:45.868846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 768/1545] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:45.874102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:45.883038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 778/1546] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:58:45.897732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:45.918979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973800-3eeb-41cd-a936-d3ad190796ad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.019880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499d16-60c9-41dd-9720-f409f3b1622c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.023240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.024288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.024829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.025390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.026336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.027639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:46.027639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:58:46.027639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:58:46.029380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd6732-ecac-4033-a524-2cc5bfabd9e1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.038173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.038886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.039181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.039470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.040180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.041636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:46.041636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:58:46.041636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:58:46.043733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5863b06-b22a-451d-ba1b-126f082699be admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.153788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 769/1547] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:46.156650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220366-0f6a-46a6-adfd-5dc7db54c211 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.156650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220366-0f6a-46a6-adfd-5dc7db54c211 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.156650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220366-0f6a-46a6-adfd-5dc7db54c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.181859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 779/1548] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:45 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:46.183519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef7cc-b476-40f8-a12e-bbf28455c0da None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.184710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7d220366-0f6a-46a6-adfd-5dc7db54c211 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.184840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef7cc-b476-40f8-a12e-bbf28455c0da None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.185073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef7cc-b476-40f8-a12e-bbf28455c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.187606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7d220366-0f6a-46a6-adfd-5dc7db54c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.212407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-607ef7cc-b476-40f8-a12e-bbf28455c0da None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.216629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-607ef7cc-b476-40f8-a12e-bbf28455c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.277978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 770/1549] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.279968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.280268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.280554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.291552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 780/1550] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.293086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.293553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.294053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.305735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.306952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.315500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 771/1551] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.315972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.316304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.316952 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.325551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 781/1552] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.326166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415192-ef2d-4187-b957-6fa13e91c049 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.327280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.331401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.332080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.332364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.332660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.333390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.335000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8319fc-7dcc-4be1-b2e5-2472c5bcda1f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.338869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68927757-c088-4730-b7c1-7ae22eb8b34f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.344089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.345045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.345389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 772/1553] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:46.345841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.346349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.346651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a645c-e2b9-4722-954e-40bf6f49b472 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.346941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a645c-e2b9-4722-954e-40bf6f49b472 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.347221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a645c-e2b9-4722-954e-40bf6f49b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.347636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.350932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d28c-0a7b-480f-b0a3-cf2924e5ce7b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.365178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a71a645c-e2b9-4722-954e-40bf6f49b472 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.366385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a71a645c-e2b9-4722-954e-40bf6f49b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.374344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 773/1554] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.375370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764dc09-f1ac-4771-94b0-c094d9ab62cc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.375659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764dc09-f1ac-4771-94b0-c094d9ab62cc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.376477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764dc09-f1ac-4771-94b0-c094d9ab62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.394959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6764dc09-f1ac-4771-94b0-c094d9ab62cc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.396151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6764dc09-f1ac-4771-94b0-c094d9ab62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.403904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 774/1555] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.405070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f99f6-24c2-43ad-85eb-cbc01726a0a8 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.405345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f99f6-24c2-43ad-85eb-cbc01726a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.405623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f99f6-24c2-43ad-85eb-cbc01726a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.425063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bd5f99f6-24c2-43ad-85eb-cbc01726a0a8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.426252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bd5f99f6-24c2-43ad-85eb-cbc01726a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.433963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 775/1556] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.435147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c81-5b64-4596-8f42-e9f205c18595 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.435439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c81-5b64-4596-8f42-e9f205c18595 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.435718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c81-5b64-4596-8f42-e9f205c18595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.452861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7f449c81-5b64-4596-8f42-e9f205c18595 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.454028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7f449c81-5b64-4596-8f42-e9f205c18595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.461960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 776/1557] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.462919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.463204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.463482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.480930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.482109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.488100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 782/1558] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:46.489539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83aab-5199-44fb-97c0-d8974612a77f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.489911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83aab-5199-44fb-97c0-d8974612a77f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.490273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83aab-5199-44fb-97c0-d8974612a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.491213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 777/1559] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.491774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.502715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74b0d-bae5-4f4f-a850-dfc31779d2b5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.507370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.508057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.508342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.508640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.509498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.510987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35f8e5-6d2d-424c-8a66-bd0353f93034 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.513998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ccd83aab-5199-44fb-97c0-d8974612a77f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.515401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ccd83aab-5199-44fb-97c0-d8974612a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.517175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:46.523295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 778/1560] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:46.524555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.524865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.525057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 783/1561] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.525230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.526885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.527184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.527469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.546309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.546552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:46.547504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.547699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:46.557113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 779/1563] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.560905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.561194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 784/1563] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:46.561948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.566973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:46.572060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bbf6d-002d-4628-a243-76b18db436f6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.572191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae5fa-23d5-4d78-a996-bcc6611fbcd1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.572501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.573258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.573546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.573961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.574748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.575057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.576086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:46.576086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:58:46.576086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:58:46.576872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.577068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.577685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.578035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.578380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.579211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.579863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.581490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.589701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 780/1564] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.590801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.593461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 785/1565] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.594392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.602327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c714b-ccb8-4520-9794-000d3ee92425 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.606818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.607474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.607760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.608036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.608797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.611044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.611194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691815-7b31-45e3-b050-8c242afa75d7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.617042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.617709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.617991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.618295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.618992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.619300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.620913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.627249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 781/1566] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:46.628184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.636505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 786/1567] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.637405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.638280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ae21-c8b4-47f0-818e-ce26b4890d1f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.644360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.645623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.645907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.646107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] PATH_INFO: `/v3/projects/8e0a89b147ce4ccaa47f7ae0f2d66fdf/users/b7885ae5d9de498d8664da4bab204987/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.649490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357fffb-b84e-4d28-972e-6b493378ae63 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.654222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.654945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.655234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.655515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.656243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.656554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.659393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.668423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0a89b147ce4ccaa47f7ae0f2d66fdf, user_id=b7885ae5d9de498d8664da4bab204987, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.671106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.671613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.672267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.687320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f080a-8296-4817-85f3-2eae989e4154 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.692170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.692853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.693138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.693418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.694132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.694441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.696020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.708449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 788/1569] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.709262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.718535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60504d-01c7-4524-bae7-1ff44624dcb9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.723906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.724578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.725208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.725208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.725821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:46.726127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.727691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.739709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 789/1570] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:46.740540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.749856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259cc2-558e-48ef-95da-f3f895981943 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.754645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 782/1571] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:46 2022] PUT /identity/v3/projects/8e0a89b147ce4ccaa47f7ae0f2d66fdf/users/b7885ae5d9de498d8664da4bab204987/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:46.755469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.812321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.813017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.813298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.814170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.814872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.816910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.828226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425adbc-4905-41de-ba2c-3b46e18f8f89 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:46.833741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:46.834533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:46.834827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:46.835145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:46.835899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:46.837961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:46.917381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 790/1572] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:46.918308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.953130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 783/1573] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:46.955194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:46.985939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e285d-e706-4237-ae4c-c63cfe707cb8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.015104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:47.022376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486b19-aa89-4cce-b6bb-1160b466cd11 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.027274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.033813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.033813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.033813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.033813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.033813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.046922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.047605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.048122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.048411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.049196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.050854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.061639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 791/1574] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:47.062525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.072627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109d3c2-9f27-462d-a30a-555bec2e1a3a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.077241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.077872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.078178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.078447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.079822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.081819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.108200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 784/1575] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:46 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.109092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.127131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:47.172568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44590-310b-4eea-a12f-53210454b19b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.177870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.178544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.178859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.179157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.179857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.181870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34bb3-db95-4040-af95-265e18593dd8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.191724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 792/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.198993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.256448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bf736-6d51-4956-b5e5-5541de4c154c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.261323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.263162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.263162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.263162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.263413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.265137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.319386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 785/1577] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.320209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.320530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.320846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.338563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:47.339765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:47.348531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 793/1578] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.349247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.410088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 786/1579] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:47.410945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.420919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9350ec-ef75-4cd7-b3e4-645fe8855ace None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.425029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2e05-7cda-4af7-8ce9-36b73b314b25 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.426799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.427486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.427784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.428064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.428800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.430597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.430799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.431369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.431666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.431976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.432685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.435113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.506112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 787/1580] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.507088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.517942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2767-89dc-4be1-a58b-db8fd01a9e3b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.522650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.523530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.523818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.524222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] PATH_INFO: `/v3/projects/f5c6190d58d6403fbf8de5f190d795db/users/da21854a92e44dfa80fed9cda8dabb9c/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.536204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 794/1581] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.537086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.541480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c6190d58d6403fbf8de5f190d795db, user_id=da21854a92e44dfa80fed9cda8dabb9c, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.544545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.547300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061205-8061-427e-ac0d-6f6da1e103b9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.552302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.553001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.553292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.553569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.554268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.556483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.615093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 788/1582] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:47 2022] PUT /identity/v3/projects/f5c6190d58d6403fbf8de5f190d795db/users/da21854a92e44dfa80fed9cda8dabb9c/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:47.615964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.632782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:47.638478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 795/1583] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.639259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.650478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04ad6d-b199-40b0-8679-df4598e0e07f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.680726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e558b4-a94e-4f64-9d38-bc0047727ce2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.687629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.689246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.689753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.690206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.691299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.694490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.701338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:47.713447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.714127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.714415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.714699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.715390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.717368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.797704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 789/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.799793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.816798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36cf42-f8b0-42cb-9d74-000acafc358f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.825007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.825692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.826140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.826445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.827158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.827701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 796/1585] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.828758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.829783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae982e-07c3-45b4-b5e0-02f88dd7ae82 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.886667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d7c81-c688-4364-b987-501039f77ef3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.890266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.890928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.891499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.891815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.901134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.902577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.913038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 797/1586] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:47.913850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.923324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c93d9-327e-4434-925b-e130392c072d service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.928123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.928816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.929108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.929389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.930122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.931813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.943494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 798/1587] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:47.944360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.954966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3fd5-b044-4e57-8a29-08da498d9348 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.959695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.960366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.960680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.960963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.961693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.963280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:47.966863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 790/1588] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:47.968380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.968722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.969009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.978269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 799/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:47.979421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:47.988820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:47.989536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15cac-c9d1-4d56-85dc-4a86b26acfed admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:47.990048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:47.994138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:47.994851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:47.995323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:47.995453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:47.996121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:47.997736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.016399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 791/1590] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:48.016399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.016399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f934e0-2ef6-4f50-bc23-36eb1352c045 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.017414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 800/1591] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.017414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.017640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.017640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.017640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.017640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.018622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.020262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.023470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecbba4-bee0-4fd1-9506-0f94180f9946 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.028531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.029453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.029742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.030025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.030760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.034319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 792/1592] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.034497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.034713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.043562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33807a-6d20-4121-b4f4-d835be9ede62 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.046739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 801/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.050331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.052574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.053302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.053598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.053885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.054723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.056446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.058890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c69c2-a144-4904-917a-317994868b78 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.065212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.065903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.066595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.066882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.067626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.069436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.072071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 793/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.073790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.086196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 802/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.086421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299376c-fdf1-470b-acdd-fed12db1c785 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.088382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.092218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.093019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.093318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.093601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.094347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.096638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.100850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539be0-1678-414f-9d64-eb518319191e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.106661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.107671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.108178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.108667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.108804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 794/1596] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.109730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.109861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.112701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.121776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73af08b-44ab-4593-976b-d8c81ea84444 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.125930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.126901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.127196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.127486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.128098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 803/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.129291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.142168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5996c-2f18-4bc2-9d30-892366e57efe admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.146140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.146140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.147137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.147806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.148088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.148385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.149174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.150759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.156471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 795/1598] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:48.158420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.165866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 804/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.165866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.169437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42d195-e221-415c-8430-913af85c7b6e service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.177087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.178149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274144e6-dd79-46ba-a2df-94487c42a64b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.178295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.178487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.178838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.179663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.181336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.184808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.184808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.184808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.185151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] PATH_INFO: `/v3/projects/53f65cad94804849bf57f4533761ab3c/users/09cd0b66ae0145cb9e533335e23e2dc9/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.193818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 796/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.194657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.199341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:48.202886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f65cad94804849bf57f4533761ab3c, user_id=09cd0b66ae0145cb9e533335e23e2dc9, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.207819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:48.207819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:58:48.207819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:58:48.208123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ddd20-fa11-45a5-a84c-29587eb18c35 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.208232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.211479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.212151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.212508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.212835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.213577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.215218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.227188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 797/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:48.238322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.242155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59203c1-b7f3-4f9c-b086-1c1bdfa2c846 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.247108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.248003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.248294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.248579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] PATH_INFO: `/v3/projects/90adf482e4094f82be9f2c6a88e5ee8f/users/17c6b110155e4420b486c7b45f6e1b5d/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.267198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90adf482e4094f82be9f2c6a88e5ee8f, user_id=17c6b110155e4420b486c7b45f6e1b5d, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.270138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.322646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 805/1602] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/53f65cad94804849bf57f4533761ab3c/users/09cd0b66ae0145cb9e533335e23e2dc9/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.323423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.355654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 798/1603] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/90adf482e4094f82be9f2c6a88e5ee8f/users/17c6b110155e4420b486c7b45f6e1b5d/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.355654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.420480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3018-b8be-4cdf-a81c-6170092384ed admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.449931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c550c-10db-4f08-9eff-1797d0384d7c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.455725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.460999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.460999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.460999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] PATH_INFO: `/v3/projects/af61042487e147a9b875323c70d1e47a/users/2f8cb56a10cf4ebba07a794e9b21b5ac/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.475150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af61042487e147a9b875323c70d1e47a, user_id=2f8cb56a10cf4ebba07a794e9b21b5ac, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.478067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.484120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.485090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.489634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.489634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] PATH_INFO: `/v3/projects/ef2c3dfe3a90401580ae3b7a23eb5bed/users/3d12414bb5744f8fb859af3226d934bb/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.504751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2c3dfe3a90401580ae3b7a23eb5bed, user_id=3d12414bb5744f8fb859af3226d934bb, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.507712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.544362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 799/1604] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/af61042487e147a9b875323c70d1e47a/users/2f8cb56a10cf4ebba07a794e9b21b5ac/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.555560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.575825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:48.601041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 806/1605] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/ef2c3dfe3a90401580ae3b7a23eb5bed/users/3d12414bb5744f8fb859af3226d934bb/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.602032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:48.648577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53285e5-9c9a-4df7-86a6-6724699d8725 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.697423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d030-1d0d-4dbb-8674-f2e2bdaee71f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:48.700271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.701245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.701536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.701821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] PATH_INFO: `/v3/projects/6c28efed16244d2d9f43da4a441031a7/users/2e88ad2e00984607a96a3e39d35e223d/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.721301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c28efed16244d2d9f43da4a441031a7, user_id=2e88ad2e00984607a96a3e39d35e223d, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.724673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1149d5-178f-479c-b834-f632cff52b9c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.726587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:48.727332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.727627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.728096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] PATH_INFO: `/v3/projects/2a9c7cdf70e141a9a0cac1df6b0fce3a/users/68dbba8e29d34b619ef042abf2e79021/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.747237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9c7cdf70e141a9a0cac1df6b0fce3a, user_id=68dbba8e29d34b619ef042abf2e79021, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:48.750013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262319-19ea-4cc4-b127-d28f74f5f48f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:48.851279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 807/1606] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/6c28efed16244d2d9f43da4a441031a7/users/2e88ad2e00984607a96a3e39d35e223d/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.852818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9df6-1e57-42c8-b7bb-ef9eb5e9f6ee None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.853081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9df6-1e57-42c8-b7bb-ef9eb5e9f6ee None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.853285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9df6-1e57-42c8-b7bb-ef9eb5e9f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.861103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:48.877063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e61e9df6-1e57-42c8-b7bb-ef9eb5e9f6ee None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:48.885507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e61e9df6-1e57-42c8-b7bb-ef9eb5e9f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:48.885650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 800/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:48 2022] PUT /identity/v3/projects/2a9c7cdf70e141a9a0cac1df6b0fce3a/users/68dbba8e29d34b619ef042abf2e79021/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:48.885650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafcff4-83bb-4b53-b522-9f7f2b679197 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.885650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafcff4-83bb-4b53-b522-9f7f2b679197 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.885650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafcff4-83bb-4b53-b522-9f7f2b679197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.902291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4bafcff4-83bb-4b53-b522-9f7f2b679197 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:48.903811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4bafcff4-83bb-4b53-b522-9f7f2b679197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:48.994573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 801/1609] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:48.995003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 808/1608] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:48.997178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933768a-b507-44ee-a4a2-098fd042079e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.997859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933768a-b507-44ee-a4a2-098fd042079e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:48.998370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933768a-b507-44ee-a4a2-098fd042079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:48.999601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b2da-3d84-4929-a08c-170fe49b1870 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:48.999900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b2da-3d84-4929-a08c-170fe49b1870 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.000291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b2da-3d84-4929-a08c-170fe49b1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.035593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b933768a-b507-44ee-a4a2-098fd042079e None None] MFA Rules not processed for user `3d12414bb5744f8fb859af3226d934bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.036836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c048b2da-3d84-4929-a08c-170fe49b1870 None None] MFA Rules not processed for user `2f8cb56a10cf4ebba07a794e9b21b5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.037441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b933768a-b507-44ee-a4a2-098fd042079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.038073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c048b2da-3d84-4929-a08c-170fe49b1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.074220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.108501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 802/1610] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.113938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.114240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.114528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.115682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 809/1611] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.117018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.117372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.117747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.147849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.149298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.156056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] MFA Rules not processed for user `68dbba8e29d34b619ef042abf2e79021`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.159021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.160600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 803/1612] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.165384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.264152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0de847-f8c2-4a99-a690-8520357bd6d1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.271492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 810/1613] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.271492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.272376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.273302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.273691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.274049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.280904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613849f-5f4b-49bb-872a-e29d18eb3910 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.286690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.287371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.287846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.288308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.292157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.294114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.300037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.301553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45e526-282b-4d12-9baa-5e52cc13bf4a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.308128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 804/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:49.309284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.312530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 811/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:49.314977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a760-edf5-4439-8f53-79d016fda2d2 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.315275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a760-edf5-4439-8f53-79d016fda2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.315562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a760-edf5-4439-8f53-79d016fda2d2 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.316962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 812/1616] 10.222.0.57 () {54 vars in 961 bytes} [Wed May 25 14:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:58:49.323032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94a760-edf5-4439-8f53-79d016fda2d2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.324024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812817-0cda-41b1-b49d-5a4bb54cb1b8 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.330032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.330830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.331115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.331393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.332087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.334059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6857e94-e55e-40cc-a35e-591030259bb5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.339259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94a760-edf5-4439-8f53-79d016fda2d2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.343498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.344162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.344450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.345297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.355245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.356974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e74e3-02c5-478c-af76-86face374f64 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.362356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.369367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 813/1617] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:49.371402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582756a-4fac-43d5-b6b7-360d9a1ecc4c None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.371695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582756a-4fac-43d5-b6b7-360d9a1ecc4c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.372191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582756a-4fac-43d5-b6b7-360d9a1ecc4c None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.374080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 814/1618] 10.222.0.57 () {54 vars in 961 bytes} [Wed May 25 14:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:58:49.374533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.374912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.375090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.397222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.399223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.447880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 805/1619] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:49.447880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.447880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.447880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.465576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:49.466771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:49.469124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 815/1620] 10.222.0.57 () {58 vars in 1058 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.470528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.485776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af10d4-0c4d-49a5-992b-526f0375f484 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.552503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 806/1621] 10.222.0.57 () {58 vars in 1058 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:49.571716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.571716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f27ff6-0b07-4e76-87c8-ffe447646685 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.575624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.576343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.576649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.577054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.579719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.580503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.581099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.581467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.582316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.584463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.648564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.650458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.661554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 807/1622] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:49.674867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.688803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065e4a0-bfbe-4457-819b-43f52949be7c service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.697933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.699840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.700140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.700692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.745898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 816/1623] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:49 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:49.749829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.775015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888ae6-8b52-4a87-8224-d1def0710957 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.796133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.797331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.797643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.800448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.801303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.805897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.857521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 817/1624] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:58:49.863060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:49.890437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.896768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9907f-7fc2-488b-9b38-7693c64cf762 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:49.896906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42570-05a3-4e38-847a-6d4b180425b0 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.909125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:49.910502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:49.910794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:49.911077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] PATH_INFO: `/v3/projects/bc3df4a63bb54b01804a6923deccfc6c/users/4d1df8931c55401c907f7f6bcdffa11d/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:49.918598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 808/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:49.940661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3df4a63bb54b01804a6923deccfc6c, user_id=4d1df8931c55401c907f7f6bcdffa11d, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:49.944506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:49.983550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:50.010763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666acf-b06b-40de-9a7c-0f3644d42a68 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.011717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666acf-b06b-40de-9a7c-0f3644d42a68 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.012186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666acf-b06b-40de-9a7c-0f3644d42a68 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.014128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 809/1626] 10.222.0.57 () {54 vars in 912 bytes} [Wed May 25 14:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:58:50.027385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.027385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.027385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.055048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:50.059389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:50.059644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 818/1627] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:49 2022] PUT /identity/v3/projects/bc3df4a63bb54b01804a6923deccfc6c/users/4d1df8931c55401c907f7f6bcdffa11d/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:50.064415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.204986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 810/1628] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:50.225541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.245934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8d59d-cee6-4dd0-8dab-2a25ff25f43f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.250604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.253399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.254001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.254511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.255533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:50.257700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a228f-0f66-4b7f-90ad-14e46a6a7890 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:50.272507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 819/1629] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:50.280043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19ccd-3da4-44ce-85a0-2c0e52c451d4 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.280043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19ccd-3da4-44ce-85a0-2c0e52c451d4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.280043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19ccd-3da4-44ce-85a0-2c0e52c451d4 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.280043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 820/1630] 10.222.0.57 () {54 vars in 912 bytes} [Wed May 25 14:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:58:50.280043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19ccd-3da4-44ce-85a0-2c0e52c451d4 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.294105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19ccd-3da4-44ce-85a0-2c0e52c451d4 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.301852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.303180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.304220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.304220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] PATH_INFO: `/v3/projects/bc3df4a63bb54b01804a6923deccfc6c/users/4d1df8931c55401c907f7f6bcdffa11d/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.306524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3df4a63bb54b01804a6923deccfc6c, user_id=4d1df8931c55401c907f7f6bcdffa11d, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:50.310462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578714e-69e3-4bfe-b618-2b47f6415e9b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:50.323833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261012f6-eeb6-46c2-95eb-cc15635ecf4b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.331031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.332758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.333153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.333624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.344411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 821/1631] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:50 2022] PUT /identity/v3/projects/bc3df4a63bb54b01804a6923deccfc6c/users/4d1df8931c55401c907f7f6bcdffa11d/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:50.346995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.347702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.348240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.351510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:50.353005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62abe1-4950-4c15-8811-62b2c9378c43 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:50.366184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 811/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:58:50.367840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc953-801e-4642-ae93-b1dfc3b47c5c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.368148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc953-801e-4642-ae93-b1dfc3b47c5c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.368436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc953-801e-4642-ae93-b1dfc3b47c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.400294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:50.404209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:50.414852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-aeacc953-801e-4642-ae93-b1dfc3b47c5c None None] MFA Rules not processed for user `4d1df8931c55401c907f7f6bcdffa11d`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:50.417433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-aeacc953-801e-4642-ae93-b1dfc3b47c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:50.420557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:50.524680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 822/1633] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:50.542243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.600140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 812/1634] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:50.600383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea142-0c7d-4dbc-b3fe-1eee3ee2150b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.601333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea142-0c7d-4dbc-b3fe-1eee3ee2150b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.601635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea142-0c7d-4dbc-b3fe-1eee3ee2150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.669487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec056a0-c3cb-4bdc-a5eb-ff8c2b2ac220 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.680768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c4aea142-0c7d-4dbc-b3fe-1eee3ee2150b None None] MFA Rules not processed for user `da21854a92e44dfa80fed9cda8dabb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:50.680768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c4aea142-0c7d-4dbc-b3fe-1eee3ee2150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:50.685224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.687240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.687240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.687240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.706362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:50.708188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:50.736905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 823/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:50.738684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.760954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f71e0-1120-4b22-9163-fa8c9b1440a6 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.771375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.777845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.777845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.777845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.778421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 813/1636] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:50.787692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.787943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.788200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:50.807444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:50.811127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:50.830144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] MFA Rules not processed for user `da21854a92e44dfa80fed9cda8dabb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:50.831714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:50.846357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 824/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:50.872708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 814/1638] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:50.955739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:50.957492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.972744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:50.975083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda9e1c-b29c-4a10-a1d0-5d710464a487 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:50.991984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:50.999177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:50.999177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:50.999177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.004078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:51.005769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13a30-42cc-4317-98d2-87eaf515890e service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:51.017439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 825/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:51.289368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57986e7-a508-439a-9bb8-f80b1e63df09 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:51.289368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:51.289368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.289368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.342606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] PATH_INFO: `/v3/users/2f8cb56a10cf4ebba07a794e9b21b5ac` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.342606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8cb56a10cf4ebba07a794e9b21b5ac)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:51.342606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:51.570962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8cb56a10cf4ebba07a794e9b21b5ac'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:51.600128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8cb56a10cf4ebba07a794e9b21b5ac'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:51.601074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8cb56a10cf4ebba07a794e9b21b5ac'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:51.601866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8cb56a10cf4ebba07a794e9b21b5ac'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:51.689403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c38f-1aee-46b7-8e8e-8903f195cc19 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.689699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c38f-1aee-46b7-8e8e-8903f195cc19 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.689988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c38f-1aee-46b7-8e8e-8903f195cc19 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.691887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 826/1640] 10.222.0.57 () {54 vars in 912 bytes} [Wed May 25 14:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:58:51.698459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.698761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.699050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.706074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dcd6ec55-e443-4c77-bc1c-2488287cb755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8cb56a10cf4ebba07a794e9b21b5ac'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:51.730591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 815/1641] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:58:50 2022] DELETE /identity/v3/users/2f8cb56a10cf4ebba07a794e9b21b5ac => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:51.735332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.735817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.736587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.746817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:51.765616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:51.770371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:51.772429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:51.773754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:51.793455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:51.841095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 827/1642] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:58:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:58:51.894364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:51.895768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:51.902455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 816/1643] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:51.916153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd51181-3151-42e7-a7aa-956900df4d57 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:51.921506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:51.922978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:51.925302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.925748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.926026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.933840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47246d8c-6ab3-418c-86d8-7b462cec22cc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:51.934793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:51.936243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:51.938286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:51.939358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:51.939875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:51.940108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:51.946898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 828/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:58:51.954839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:51.956452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a203a-91ce-49f8-98d5-d4a42258aba1 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:51.967229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 817/1645] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:58:52.265591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:52.268199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:52.295154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3408-0abc-47e2-884e-2d3490fc71f4 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:52.306069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:52.306742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:52.307100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:52.307452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] PATH_INFO: `/v3/users/3d12414bb5744f8fb859af3226d934bb` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:52.310373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d12414bb5744f8fb859af3226d934bb)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:52.311642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: WARNING py.warnings [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:52.311642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: warnings.warn(msg) May 25 14:58:52.311642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: May 25 14:58:52.313039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:52.635294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d12414bb5744f8fb859af3226d934bb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:52.636677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d12414bb5744f8fb859af3226d934bb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:52.685122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d12414bb5744f8fb859af3226d934bb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:52.686684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d12414bb5744f8fb859af3226d934bb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:52.787348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e4d5b785-a405-4615-8c93-a4430fce75f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d12414bb5744f8fb859af3226d934bb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:52.867910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 829/1646] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:58:52 2022] DELETE /identity/v3/users/3d12414bb5744f8fb859af3226d934bb => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:52.869156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec53ae0-a824-409d-9243-7cc87d11e07d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:52.869928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec53ae0-a824-409d-9243-7cc87d11e07d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:52.870721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec53ae0-a824-409d-9243-7cc87d11e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:52.902473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bec53ae0-a824-409d-9243-7cc87d11e07d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:52.903720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907454-6abc-44ec-aa8c-c21d76a1e4b6 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:52.904070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907454-6abc-44ec-aa8c-c21d76a1e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:52.904361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907454-6abc-44ec-aa8c-c21d76a1e4b6 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:52.904777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bec53ae0-a824-409d-9243-7cc87d11e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:52.907757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 830/1647] 10.222.0.57 () {54 vars in 960 bytes} [Wed May 25 14:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:58:52.924668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:52.924960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:52.925248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:52.977816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:52.979118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.049053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 818/1648] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:58:53.050595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:53.050898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:53.051203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:53.107605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] MFA Rules not processed for user `17c6b110155e4420b486c7b45f6e1b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:53.109391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.166234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:53.203020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 831/1649] 10.222.0.57 () {58 vars in 1057 bytes} [Wed May 25 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:53.205326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.207159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.237234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7400943-5c0d-48dd-a392-f15f81c58e95 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:53.249032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:53.252178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:53.253375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:53.254051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] PATH_INFO: `/v3/projects/af61042487e147a9b875323c70d1e47a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:53.254190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 819/1650] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:53.255303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.256669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af61042487e147a9b875323c70d1e47a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:53.263393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.263536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:53.306147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:53.347818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc2dc8-5627-4118-b98d-28eb565ed1c8 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:53.351782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:53.353501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:53.353501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:53.353501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:53.364159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:53.367099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:53.384818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 820/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:53.385701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.401024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4869c0-3af8-4d1a-b5d9-873c44d29c24 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:53.408476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:53.409527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:53.410047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:53.410474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:53.412717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.431793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:53.434254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:53.455577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 821/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:53.456735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.462367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.491480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af61042487e147a9b875323c70d1e47a', 'request_id': 'req-90485248-bb1c-4e4c-b46b-adc217612a93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:53.515950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6cbb-e859-4606-b395-9ed9375a8c16 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:53.612896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af61042487e147a9b875323c70d1e47a', 'request_id': 'req-90485248-bb1c-4e4c-b46b-adc217612a93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:53.623585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af61042487e147a9b875323c70d1e47a', 'request_id': 'req-90485248-bb1c-4e4c-b46b-adc217612a93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:53.654134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] The token cache is being invalidate because project af61042487e147a9b875323c70d1e47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:58:53.654414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:53.656194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:53.668504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 832/1653] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:58:53 2022] DELETE /identity/v3/projects/af61042487e147a9b875323c70d1e47a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:53.670144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.677413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.713924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:53.715875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:53.716168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:53.716547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:53.717299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:53.720500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:53.824764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 822/1654] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:53 2022] POST /identity/v3/projects => generated 401 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:53.825695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:53.835206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:53.843372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485248-bb1c-4e4c-b46b-adc217612a93 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:53.991000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736cc67-90ae-4d0f-9a8d-818da2a744c4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.003948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.004922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.005358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.005787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.006629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.011338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.027100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.028318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.030629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.031223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] PATH_INFO: `/v3/users/4d1df8931c55401c907f7f6bcdffa11d` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.037401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1df8931c55401c907f7f6bcdffa11d)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.042434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.142592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 823/1655] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:53 2022] POST /identity/v3/users => generated 307 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:54.144328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:54.165793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6808d-cabe-44e3-a021-f02cd609fdfb admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.182976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.183681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.183971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.184266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.185089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.186733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.216843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 824/1656] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:54.220216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:54.250498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935c63e-ead8-45cf-9d19-8b6dd879710d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.257040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.257963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.258251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.258533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] PATH_INFO: `/v3/projects/22e0e1295a974f7c9bd2806199773dd4/users/0b631fe3d4dd400aa85122428d47cb3f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.285093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e0e1295a974f7c9bd2806199773dd4, user_id=0b631fe3d4dd400aa85122428d47cb3f, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.289870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.356232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1df8931c55401c907f7f6bcdffa11d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:54.357434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1df8931c55401c907f7f6bcdffa11d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:54.370132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1df8931c55401c907f7f6bcdffa11d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:54.371262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 825/1657] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:54 2022] PUT /identity/v3/projects/22e0e1295a974f7c9bd2806199773dd4/users/0b631fe3d4dd400aa85122428d47cb3f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:54.372103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1df8931c55401c907f7f6bcdffa11d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:54.372895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:54.377248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:54.474646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1df8931c55401c907f7f6bcdffa11d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:54.529667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d93d8-181e-411b-b9ee-2ecfaf91c6b2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.541060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.543543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.543640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 833/1658] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:58:53 2022] DELETE /identity/v3/users/4d1df8931c55401c907f7f6bcdffa11d => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:54.543712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.543712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.543712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.545408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.570695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 826/1659] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:54.572031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:54.703796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa9c2-8fa9-478b-a735-a4c229150218 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.709958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.711031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.711323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.711612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] PATH_INFO: `/v3/projects/22e0e1295a974f7c9bd2806199773dd4/users/0b631fe3d4dd400aa85122428d47cb3f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.714007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e0e1295a974f7c9bd2806199773dd4, user_id=0b631fe3d4dd400aa85122428d47cb3f, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.720346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97247f0f-03a7-4b78-85ba-c268cb359b5c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:54.731741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:54.734706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:54.747000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 834/1660] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:54 2022] PUT /identity/v3/projects/22e0e1295a974f7c9bd2806199773dd4/users/0b631fe3d4dd400aa85122428d47cb3f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:58:54.784586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e16b9c-1825-4c2d-b918-bc1bac914f4a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:54.791956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:54.921507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:54.922423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:54.922708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:54.923218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] PATH_INFO: `/v3/projects/ef2c3dfe3a90401580ae3b7a23eb5bed` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:54.925033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2c3dfe3a90401580ae3b7a23eb5bed)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:54.926403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: WARNING py.warnings [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:54.926403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: warnings.warn(msg) May 25 14:58:54.926403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: May 25 14:58:54.927674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:55.116146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2c3dfe3a90401580ae3b7a23eb5bed', 'request_id': 'req-7d400193-9715-4fd0-a200-dbcad217f5eb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:55.168701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2c3dfe3a90401580ae3b7a23eb5bed', 'request_id': 'req-7d400193-9715-4fd0-a200-dbcad217f5eb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:55.183375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2c3dfe3a90401580ae3b7a23eb5bed', 'request_id': 'req-7d400193-9715-4fd0-a200-dbcad217f5eb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:55.270017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:55.349009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] The token cache is being invalidate because project ef2c3dfe3a90401580ae3b7a23eb5bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:58:55.353420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:55.353420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7d400193-9715-4fd0-a200-dbcad217f5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:55.355486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 827/1661] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:58:54 2022] DELETE /identity/v3/projects/ef2c3dfe3a90401580ae3b7a23eb5bed => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:55.360988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:55.364034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:55.364475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:55.437716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:55.440183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:55.606059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 835/1662] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:55.614465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:55.614902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:55.615194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:55.653779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:55.655493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:55.668811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 828/1663] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:55.672736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:55.700134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423a57-6d9c-42a1-a965-cb756dfb2e5a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:55.706036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:55.707078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:55.707512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:55.707984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:55.709643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:55.710169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:55.714441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:55.759806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 836/1664] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:55.764713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:55.779064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d41b95-b161-46e0-b0a1-1ee234340e7d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:55.794397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:55.795108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:55.796554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:55.797327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:55.798913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:55.804674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:55.970676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 829/1665] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:55 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:55.975615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:55.991262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5198c-5863-442d-bcb7-2fff04b8e196 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:56.175922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:56.176831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:56.177057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:56.177402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:56.178056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:56.180334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:56.305488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:56.321834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 837/1666] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:55 2022] POST /identity/v3/users => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:56.322633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:56.338979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b752d-3da9-4cc0-b0f4-95da1db124cf admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:56.351961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:56.352970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:56.353552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:56.353920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:56.354759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:56.356885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:56.380127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 830/1667] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:58:56.380938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:56.396115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6006c-e884-4d39-be1a-c9a179720a97 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:56.397766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:56.401641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:56.441432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1bad1-b9be-4c6e-83aa-4ed39a4fdf17 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:56.450538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:56.451448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:56.451779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:56.453083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] PATH_INFO: `/v3/users/68dbba8e29d34b619ef042abf2e79021` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:56.457376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dbba8e29d34b619ef042abf2e79021)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:56.460714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:56.464442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:56.465245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:56.465540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:56.465895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:56.466662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:56.468408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:56.486937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 838/1668] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:56.488162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:56.498504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:56.558061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de519-c257-42e1-83de-070ceac1c74e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:56.587079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:56.589171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:56.589589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:56.589874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] PATH_INFO: `/v3/projects/bc3df4a63bb54b01804a6923deccfc6c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:56.593139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3df4a63bb54b01804a6923deccfc6c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:56.601588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:56.693076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dbba8e29d34b619ef042abf2e79021'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.743550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dbba8e29d34b619ef042abf2e79021'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.744752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dbba8e29d34b619ef042abf2e79021'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.746363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dbba8e29d34b619ef042abf2e79021'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.853201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3df4a63bb54b01804a6923deccfc6c', 'request_id': 'req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.927261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dbba8e29d34b619ef042abf2e79021'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:56.958447 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 831/1669] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:58:56 2022] DELETE /identity/v3/users/68dbba8e29d34b619ef042abf2e79021 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:56.962258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:56.971862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.069128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3df4a63bb54b01804a6923deccfc6c', 'request_id': 'req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:57.081581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3df4a63bb54b01804a6923deccfc6c', 'request_id': 'req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:57.114633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] The token cache is being invalidate because project bc3df4a63bb54b01804a6923deccfc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:58:57.114941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:57.117020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5410e4a7-40b5-402e-a9c2-3ca7409b2c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:57.121180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 839/1670] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:58:56 2022] DELETE /identity/v3/projects/bc3df4a63bb54b01804a6923deccfc6c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:57.129483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f265b-5e15-4f98-a5ac-a2e13d2fd699 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.129857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f265b-5e15-4f98-a5ac-a2e13d2fd699 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.130160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f265b-5e15-4f98-a5ac-a2e13d2fd699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.170806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-099f265b-5e15-4f98-a5ac-a2e13d2fd699 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:57.172090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-099f265b-5e15-4f98-a5ac-a2e13d2fd699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.184411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7996-df16-41b1-bb7c-2d37d5057d62 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:57.196344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 840/1671] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:57.197352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23537be2-a276-484d-b180-5e562809386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:57.197714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d593e-5fc3-4690-b35a-4a9cb1cbe6c5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.198012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d593e-5fc3-4690-b35a-4a9cb1cbe6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.201241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d593e-5fc3-4690-b35a-4a9cb1cbe6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.202479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537be2-a276-484d-b180-5e562809386e admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.203079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537be2-a276-484d-b180-5e562809386e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.204485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23537be2-a276-484d-b180-5e562809386e admin admin] PATH_INFO: `/v3/projects/6ad0bb4a1cd24112938bf3ce2c8446ed/users/564a31939be54572be4c27949fe5d924/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.244911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b17d593e-5fc3-4690-b35a-4a9cb1cbe6c5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:57.246178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b17d593e-5fc3-4690-b35a-4a9cb1cbe6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.256203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23537be2-a276-484d-b180-5e562809386e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad0bb4a1cd24112938bf3ce2c8446ed, user_id=564a31939be54572be4c27949fe5d924, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:57.265125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23537be2-a276-484d-b180-5e562809386e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:57.277175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 841/1672] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:57.280478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.280815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.281162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.310357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:57.312516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.325819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 842/1673] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:57.331199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:57.351123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebb4b3-aeff-475b-b6d6-9bf4ebe33fc3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:57.366847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:57.366847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.367061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.367282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.367967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:57.372905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:57.374839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:57.408931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 843/1674] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:57.415041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 832/1675] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:56 2022] PUT /identity/v3/projects/6ad0bb4a1cd24112938bf3ce2c8446ed/users/564a31939be54572be4c27949fe5d924/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:57.415907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:57.430365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.430659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.430936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.453546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82248ba-5b96-4f8c-a43f-6de7a02baa44 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:57.470842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:57.491001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] MFA Rules not processed for user `564a31939be54572be4c27949fe5d924`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:57.492831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.596093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 833/1676] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:57.597247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:57.598814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.651271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:57.653757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.654061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.655742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.656514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:57.663351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:57.695636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148d02c-c487-44f3-b0fe-18f9db3c308f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:57.706827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:57.707980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:57.708411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:57.708925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:57.709915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:57.712107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:57.797104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 844/1677] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/projects => generated 383 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:57.798906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:57.804328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:57.860289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 834/1678] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:57.861663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:57.915443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacbd36-b733-461c-b103-42ab45f92dc3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:57.998694 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04ad0-ff0d-455a-a9cb-bc1a611a3225 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.006160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.006913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.007422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.007708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.008507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.011617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.040653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:58.089452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.090508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.090699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.093659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.114503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.116672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.132483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 845/1679] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:58.135121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.152187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bc48-89d1-4efd-8918-ae9d76763f44 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.187051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 835/1680] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:57 2022] POST /identity/v3/users => generated 292 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:58.187460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.225934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.228133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.228439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.233826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.238444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.240431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.249994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169e7ff-425d-42b0-9d2c-c91d7664ef21 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.267913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.269832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.270138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.270427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.271185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.273019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.290621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 836/1681] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:58.296902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.305554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6687f-70b8-450b-866e-8f1faf5b1ee4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.312043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.314551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.314551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.314807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.315662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.317513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.345705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 837/1682] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:58.349421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.362695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42548-7515-42e4-ad0c-c7ce6c2adc5f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.368411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.369561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.370008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.370450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] PATH_INFO: `/v3/projects/b868fd6155e84f10a3046ecb54cafac1/users/0d3f2b89d87843beba3877331c312dee/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.371863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 846/1683] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:58 2022] POST /identity/v3/users => generated 308 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:58.373254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.394906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c22f1-e9f3-4611-a9a9-170fb92475b9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.413444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.414349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.414646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.414936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.415709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.424298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.458698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 847/1684] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:58.459606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.476789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731056-c7b2-4bf8-98c1-251386913c85 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.484077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.487689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.488036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.488379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] PATH_INFO: `/v3/projects/ae6ac27b42c948a7bd28887217ce1668/users/2f1069ef40e2448ca32fa909382d2d1b/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.524168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6ac27b42c948a7bd28887217ce1668, user_id=2f1069ef40e2448ca32fa909382d2d1b, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.527899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.570824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b868fd6155e84f10a3046ecb54cafac1, user_id=0d3f2b89d87843beba3877331c312dee, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.574522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd86d9e-6c81-4d94-a3e7-17ea57f65390 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:58.635735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 848/1685] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:58 2022] PUT /identity/v3/projects/ae6ac27b42c948a7bd28887217ce1668/users/2f1069ef40e2448ca32fa909382d2d1b/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:58.640835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.667355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 838/1686] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:58 2022] PUT /identity/v3/projects/b868fd6155e84f10a3046ecb54cafac1/users/0d3f2b89d87843beba3877331c312dee/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:58.684550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.684873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.685158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.755040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] MFA Rules not processed for user `0d3f2b89d87843beba3877331c312dee`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:58.756317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:58.787329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2971e2-4d0d-48c8-bc34-dbf836a0ae5d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:58.957138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 839/1687] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:58.961455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:58.993306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:58.994376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:58.995015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:58.995454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:58.996722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:58.999835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:59.025614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 849/1688] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:59.029492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:59.061374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267366-5658-466d-b020-612f2d81b142 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:59.069007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:59.070291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.070670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.071013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] PATH_INFO: `/v3/projects/ae6ac27b42c948a7bd28887217ce1668/users/2f1069ef40e2448ca32fa909382d2d1b/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.082124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6ac27b42c948a7bd28887217ce1668, user_id=2f1069ef40e2448ca32fa909382d2d1b, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:59.085604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fd120-0207-4418-b322-04ddfd75b3ad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:59.107964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 850/1689] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:58:59 2022] PUT /identity/v3/projects/ae6ac27b42c948a7bd28887217ce1668/users/2f1069ef40e2448ca32fa909382d2d1b/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:58:59.119833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ba1e-05cc-4894-af7a-1f6fbc64ec2d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.120365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ba1e-05cc-4894-af7a-1f6fbc64ec2d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.121089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ba1e-05cc-4894-af7a-1f6fbc64ec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.163037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d163e9-f051-43d0-978e-326fbf73a798 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:59.213479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b3f6ba1e-05cc-4894-af7a-1f6fbc64ec2d None None] MFA Rules not processed for user `2f1069ef40e2448ca32fa909382d2d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:59.217354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b3f6ba1e-05cc-4894-af7a-1f6fbc64ec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:59.317988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:59.350018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:59.350726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.357127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.357426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.363673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:59.363673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:59.405786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 851/1690] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:59.408263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.408569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.413324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.465762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:59.466893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:59.495335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 840/1691] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:58:58 2022] POST /identity/v3/projects => generated 383 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:59.495335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:59.499404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:59.613797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 852/1692] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:59.617205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:59.636997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461d07-c72b-4a91-aa84-d3fc0c4058ca admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:59.643430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc931-e91b-4b12-9dec-b96bbddd7151 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:59.652018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:59.652018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.652018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.652018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.883777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:59.884589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:59.884902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:59.885183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:59.886043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:59.892254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a280e-fa51-49df-bd7d-334dc956f6c6 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:59.900961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:59.912400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:59.944885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 841/1693] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:58:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:00.063946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:00.097803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 853/1694] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:58:59 2022] POST /identity/v3/users => generated 298 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:00.102610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:00.117690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:00.117987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:00.118277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:00.128313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e622a-df3c-4939-92af-a336b03452c0 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:00.156602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:00.166669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:00.166669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:00.166819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:00.172702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:00.178469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:00.216974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 842/1695] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:00.217987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:00.256689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:00.278928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] MFA Rules not processed for user `0b631fe3d4dd400aa85122428d47cb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:00.280225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:00.570825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2da3-472e-4101-b923-e9caf3ade6aa admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:00.603116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:00.603851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:00.604097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:00.605602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:00.606518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 854/1696] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:00.607379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:00.638849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd7398-d30d-4883-84b8-587501c200cd None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:00.655523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:00.656450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:00.656833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:00.657220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] PATH_INFO: `/v3/projects/07629d829a054ccab416e905cb7523f9/users/73d4b3cdcac34a9abc5e451421f89329/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:00.691488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:00.710042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07629d829a054ccab416e905cb7523f9, user_id=73d4b3cdcac34a9abc5e451421f89329, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:00.712797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:00.716138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:00.733987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:00.739899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:00.776555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 843/1697] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 14:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:59:00.779133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:00.812548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 855/1698] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:00 2022] PUT /identity/v3/projects/07629d829a054ccab416e905cb7523f9/users/73d4b3cdcac34a9abc5e451421f89329/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:00.814312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:00.823982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:00.839080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d77d-5370-4426-8824-1ddf33260b8c service swift] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:00.986661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa423-d88f-4716-8719-be1fbe82a182 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:01.002546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:01.003703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.004280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.004776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] PATH_INFO: `/v3/projects/2a9c7cdf70e141a9a0cac1df6b0fce3a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.009081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9c7cdf70e141a9a0cac1df6b0fce3a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:01.011944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:01.209706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9c7cdf70e141a9a0cac1df6b0fce3a', 'request_id': 'req-18388897-8afa-4b44-9ff4-237155cd1a2a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.219120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:01.228137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.236394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.236394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] PATH_INFO: `/v3/users/564a31939be54572be4c27949fe5d924` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.236394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564a31939be54572be4c27949fe5d924)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:01.249445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:01.294234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9c7cdf70e141a9a0cac1df6b0fce3a', 'request_id': 'req-18388897-8afa-4b44-9ff4-237155cd1a2a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.303321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9c7cdf70e141a9a0cac1df6b0fce3a', 'request_id': 'req-18388897-8afa-4b44-9ff4-237155cd1a2a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.343358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] The token cache is being invalidate because project 2a9c7cdf70e141a9a0cac1df6b0fce3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:01.343658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.345552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.358246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 856/1699] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:00 2022] DELETE /identity/v3/projects/2a9c7cdf70e141a9a0cac1df6b0fce3a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:01.359094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:01.361347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:01.489465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:01.514081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388897-8afa-4b44-9ff4-237155cd1a2a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:01.530850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:01.530850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.530850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.538929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.541675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:01.541965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564a31939be54572be4c27949fe5d924'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.546799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856346e-2cb1-4f14-b1c8-c92e8e893587 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:01.574377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564a31939be54572be4c27949fe5d924'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.575602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564a31939be54572be4c27949fe5d924'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.576417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564a31939be54572be4c27949fe5d924'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.590944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 857/1700] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:01.592986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.592986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.592986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.635983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:01.649356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:01.654703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:01.681037 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 858/1701] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:01.682921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:01.691064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f402c714-1548-413f-a0ab-67c692a9bda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564a31939be54572be4c27949fe5d924'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:01.694606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:01.718839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fefd7-3b37-4b45-b9ee-f394b9ad57f9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:01.747934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:01.747934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.747934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.747934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] PATH_INFO: `/v3/projects/07629d829a054ccab416e905cb7523f9/users/73d4b3cdcac34a9abc5e451421f89329/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.749040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 844/1702] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:00 2022] DELETE /identity/v3/users/564a31939be54572be4c27949fe5d924 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:01.752384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=07629d829a054ccab416e905cb7523f9, user_id=73d4b3cdcac34a9abc5e451421f89329, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:01.754680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.756813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.757419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.759701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0a49f-7933-48b9-9d04-71bdb22e68aa admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:01.796477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 859/1703] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:01 2022] PUT /identity/v3/projects/07629d829a054ccab416e905cb7523f9/users/73d4b3cdcac34a9abc5e451421f89329/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:01.812215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29994-9d69-4dea-850b-16d89d3bee8e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.812518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29994-9d69-4dea-850b-16d89d3bee8e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.812897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29994-9d69-4dea-850b-16d89d3bee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.838510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8af29994-9d69-4dea-850b-16d89d3bee8e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:01.840160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8af29994-9d69-4dea-850b-16d89d3bee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:01.870712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:01.878421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:01.941141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 860/1704] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:01.945673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:01.947391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:01.948020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:01.995564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] MFA Rules not processed for user `73d4b3cdcac34a9abc5e451421f89329`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:01.997302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:02.198991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 845/1705] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:02.200231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.200919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 861/1706] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:02.202684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:02.205814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.231858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee077c-49ce-4a6c-a367-fe086c6b4951 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:02.257235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:02.259224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:02.260959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:02.261673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:02.263077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:02.265331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:02.269498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:02.271892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:02.304630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 862/1707] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:02.305778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.314178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:02.362398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:02.404269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b29b9-d969-4bc6-b8e0-10522967eb82 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:02.412491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:02.413714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:02.414766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:02.417334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:02.445366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:02.447400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:02.475403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 846/1708] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:02.492254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.519367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e062-de16-4f3f-a092-d5203dfcae46 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:02.532112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:02.533155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:02.533568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:02.533856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:02.534617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:02.535810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c068d40-e4bf-4b06-8e9c-9350f0031629 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:02.539760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:02.566485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:02.695838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 863/1709] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:02.964774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.974393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d919-e80c-48a4-aa7e-cdeff0bd657c service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:02.982464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 847/1710] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:02 2022] POST /identity/v3/projects => generated 365 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:02.983042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:02.985900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:02.995604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:02.996703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:02.999202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.004468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:03.142350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02821-a334-4f8e-917a-aecd7abb962a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:03.153942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:03.158493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:03.158493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:03.158493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.159702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:03.164270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:03.263722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:03.265611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:03.286318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 848/1711] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:02 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:03.294475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 864/1712] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:03.295242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:03.337605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3658-a9c2-4f4b-8cb0-761d36f951c2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:03.357858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:03.358609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:03.358907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:03.359197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.360516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:03.373897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:03.439359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:03.443483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 849/1713] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:03.461038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717b63-ba98-484f-9967-9b015e6c6efd service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:03.478262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:03.478971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:03.479267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:03.479612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.480630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:03.494116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac010a2a-cb46-477f-8d1a-1629e74cf190 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:03.515369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 865/1714] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:03.518111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:03.555830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:03.564492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfd20e-c7dc-4240-bf36-79ca5808192e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:03.591306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:03.593053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:03.593162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:03.593502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] PATH_INFO: `/v3/projects/08843ea2b3f54fc2b5494ecd04109ce3/users/59aec87057d0439e90b86471743db5a6/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.649144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:03.653657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08843ea2b3f54fc2b5494ecd04109ce3, user_id=59aec87057d0439e90b86471743db5a6, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:03.667565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:03.801016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 850/1715] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:03 2022] PUT /identity/v3/projects/08843ea2b3f54fc2b5494ecd04109ce3/users/59aec87057d0439e90b86471743db5a6/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:03.805953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:03.806938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:03.807379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:03.899421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] MFA Rules not processed for user `59aec87057d0439e90b86471743db5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:03.901172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:04.156677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 866/1716] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:04.161859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:04.338213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175ce9-393a-4084-9dcd-b4cb93d3bb26 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:04.368360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:04.380294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:04.381706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:04.382094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:04.386540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:04.404370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e58b92-0e4f-47de-94dd-cc3425e38126 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:04.539341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 851/1717] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:04 2022] POST /identity/v3/projects => generated 365 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:04.544420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:04.592590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355ff2b-ae5e-4514-b989-509dc5818090 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:04.794014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:04.794733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:04.795067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:04.795363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:04.796182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:04.799920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:04.922821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a50b25-a87e-4700-b975-c9fda9bc02dd None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:04.927833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a50b25-a87e-4700-b975-c9fda9bc02dd None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:04.927833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a50b25-a87e-4700-b975-c9fda9bc02dd None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:04.927833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 852/1718] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:04.933962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 867/1719] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:04 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:59:04.938028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a50b25-a87e-4700-b975-c9fda9bc02dd None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:04.977808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a50b25-a87e-4700-b975-c9fda9bc02dd None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:04.994850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:04.995704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:04.996320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:04.996744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:04.997913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:05.004225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a17dc-72a3-4481-9fc4-2480c47ac31b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:05.033027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 853/1720] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:05.036670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:05.057637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8104-6da9-4eb9-83cc-9215312fa844 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:05.066174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:05.085825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.086082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.086369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.091791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:05.093181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.097280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.103164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] PATH_INFO: `/v3/projects/83f5892fc50f4c14998594b8fe826b57/users/8f331b4fe494479ea8111a2324d83729/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.125163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:05.132239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:05.163667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f5892fc50f4c14998594b8fe826b57, user_id=8f331b4fe494479ea8111a2324d83729, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:05.169858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:05.286813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 868/1721] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:05 2022] PUT /identity/v3/projects/83f5892fc50f4c14998594b8fe826b57/users/8f331b4fe494479ea8111a2324d83729/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:05.288332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:05.305313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 854/1722] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:05.330924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:05.332470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:05.357919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3e18b-eb08-4f26-a821-6973e53945cf None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:05.506054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68e402-0b89-4575-a0d1-2e8a82812abc admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:05.523588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:05.524144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.524759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.525059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.525938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:05.527771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:05.591831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 869/1723] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:05.597287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:05.624185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c20e8-8fe0-4dcf-8f35-ed5769a27564 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:05.645838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:05.650027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.650353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.650660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] PATH_INFO: `/v3/projects/83f5892fc50f4c14998594b8fe826b57/users/8f331b4fe494479ea8111a2324d83729/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.659641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f5892fc50f4c14998594b8fe826b57, user_id=8f331b4fe494479ea8111a2324d83729, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:05.660222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:05.663089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923a4b1-7563-4b7a-a2e1-950e1f69e383 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:05.694325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:05.695891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.695891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.696080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.706778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 870/1724] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:05 2022] PUT /identity/v3/projects/83f5892fc50f4c14998594b8fe826b57/users/8f331b4fe494479ea8111a2324d83729/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:05.708927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4fef-a17c-4478-bd4e-0708901e4f1c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:05.709244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4fef-a17c-4478-bd4e-0708901e4f1c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:05.709612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a4fef-a17c-4478-bd4e-0708901e4f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:05.731613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:05.737370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:05.787356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 855/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:05.825848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ae9a4fef-a17c-4478-bd4e-0708901e4f1c None None] MFA Rules not processed for user `8f331b4fe494479ea8111a2324d83729`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:05.836191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ae9a4fef-a17c-4478-bd4e-0708901e4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:05.860517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:06.113083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 871/1726] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:06.142470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:06.152145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.207543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f455c-4a9e-465b-a884-984af442ee2b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:06.208727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f455c-4a9e-465b-a884-984af442ee2b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:06.210376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f455c-4a9e-465b-a884-984af442ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:06.272278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-581f455c-4a9e-465b-a884-984af442ee2b None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:06.277170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-581f455c-4a9e-465b-a884-984af442ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.417041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3877e8-f22a-4ab6-83c8-41d540a2eed2 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:06.427137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 872/1727] 10.222.0.90 () {58 vars in 1015 bytes} [Wed May 25 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:06.428567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:06.429431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:06.429431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:06.505725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] MFA Rules not processed for user `b7885ae5d9de498d8664da4bab204987`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:06.512272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.574202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:06.574886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:06.575175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:06.575461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:06.604244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:06.606260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:06.645637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 856/1728] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:06.646563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:06.653819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.676021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 873/1729] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:06.678151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:06.682587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.718540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230d3c5-1dc2-48e9-8427-c59bf79a7234 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:06.731969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:06.732682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:06.733133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:06.733473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:06.751623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:06.758003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff0ed-66eb-4ca1-9f2c-df1266403ece service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:06.793839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 874/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:06.795392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:06.795690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:06.795972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:06.861923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] MFA Rules not processed for user `b7885ae5d9de498d8664da4bab204987`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:06.863219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.897370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 875/1731] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:06.912005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:06.913483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:06.990366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b453-2dea-49db-a1ab-6500327e1849 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:07.009149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:07.010249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:07.010544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:07.010828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] PATH_INFO: `/v3/projects/6ad0bb4a1cd24112938bf3ce2c8446ed` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:07.014311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad0bb4a1cd24112938bf3ce2c8446ed)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:07.022685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:07.067008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:07.188860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbc1ab-3b65-433d-9510-abf583cefd09 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:07.209961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:07.210884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:07.211407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:07.211706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:07.287026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:07.289979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:07.301670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:07.315706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad0bb4a1cd24112938bf3ce2c8446ed', 'request_id': 'req-a6dbf587-b3c2-4e92-b213-9229442ca6b5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:07.350483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad0bb4a1cd24112938bf3ce2c8446ed', 'request_id': 'req-a6dbf587-b3c2-4e92-b213-9229442ca6b5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:07.373524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 876/1732] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:07.406666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad0bb4a1cd24112938bf3ce2c8446ed', 'request_id': 'req-a6dbf587-b3c2-4e92-b213-9229442ca6b5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:07.566894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] The token cache is being invalidate because project 6ad0bb4a1cd24112938bf3ce2c8446ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:07.572824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:07.577370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:07.580025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 857/1733] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:06 2022] DELETE /identity/v3/projects/6ad0bb4a1cd24112938bf3ce2c8446ed => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:07.584243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:07.601708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32fb8-be41-4a8e-8b3a-7aa3dba5985e service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:07.855189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:07.856453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:07.858819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:07.865098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] PATH_INFO: `/v3/users/2f1069ef40e2448ca32fa909382d2d1b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:07.865098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1069ef40e2448ca32fa909382d2d1b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:07.865098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:08.271831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1069ef40e2448ca32fa909382d2d1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:08.273941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1069ef40e2448ca32fa909382d2d1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:08.322153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1069ef40e2448ca32fa909382d2d1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:08.323898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1069ef40e2448ca32fa909382d2d1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:08.445153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-108b68d4-0639-4e2f-966c-60999690790b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1069ef40e2448ca32fa909382d2d1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:08.529928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 877/1734] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:07 2022] DELETE /identity/v3/users/2f1069ef40e2448ca32fa909382d2d1b => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:08.758320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:08.760753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:08.792435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbf587-b3c2-4e92-b213-9229442ca6b5 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:08.887392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:08.888784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:08.889215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:08.889638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] PATH_INFO: `/v3/users/59aec87057d0439e90b86471743db5a6` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:08.894029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59aec87057d0439e90b86471743db5a6)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:08.900132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:09.058408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489761-b55b-4341-b3ad-6654e1358af2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:09.059090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489761-b55b-4341-b3ad-6654e1358af2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:09.059802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18489761-b55b-4341-b3ad-6654e1358af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:09.154381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-18489761-b55b-4341-b3ad-6654e1358af2 None None] MFA Rules not processed for user `09cd0b66ae0145cb9e533335e23e2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:09.162474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-18489761-b55b-4341-b3ad-6654e1358af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:09.202730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:09.202857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59aec87057d0439e90b86471743db5a6'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.238054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59aec87057d0439e90b86471743db5a6'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.242945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59aec87057d0439e90b86471743db5a6'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.244328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59aec87057d0439e90b86471743db5a6'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.340649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59aec87057d0439e90b86471743db5a6'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.384570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 858/1735] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:08 2022] DELETE /identity/v3/users/59aec87057d0439e90b86471743db5a6 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:09.395477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 878/1736] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:09.396089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:09.396207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57074f4b-50fd-4403-ae20-97f253195afe None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:09.396207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57074f4b-50fd-4403-ae20-97f253195afe None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:09.396207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57074f4b-50fd-4403-ae20-97f253195afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:09.396425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:09.471999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-57074f4b-50fd-4403-ae20-97f253195afe None None] MFA Rules not processed for user `2e88ad2e00984607a96a3e39d35e223d`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:09.473737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-57074f4b-50fd-4403-ae20-97f253195afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:09.605381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:09.636439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2893-4c66-425e-85d9-2da85eb898a7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:09.649150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:09.650071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:09.650357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:09.663002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] PATH_INFO: `/v3/users/0d3f2b89d87843beba3877331c312dee` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:09.665777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3f2b89d87843beba3877331c312dee)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:09.668073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:09.726262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 879/1737] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:09.726262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:09.726262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:09.726262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:09.771395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:09.772944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:09.802879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 880/1738] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:09.804222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:09.806062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:09.838515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d8869-f097-4b66-914e-931e62827a48 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:09.856973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:09.858297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:09.858823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:09.859324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] PATH_INFO: `/v3/users/17c6b110155e4420b486c7b45f6e1b5d` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:09.863107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c6b110155e4420b486c7b45f6e1b5d)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:09.865747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:09.950830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3f2b89d87843beba3877331c312dee'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.974161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3f2b89d87843beba3877331c312dee'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.975471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3f2b89d87843beba3877331c312dee'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:09.978714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3f2b89d87843beba3877331c312dee'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.071613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3f2b89d87843beba3877331c312dee'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.090387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 859/1739] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:09 2022] DELETE /identity/v3/users/0d3f2b89d87843beba3877331c312dee => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:10.091586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:10.095387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.164552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c6b110155e4420b486c7b45f6e1b5d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.165439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c6b110155e4420b486c7b45f6e1b5d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.176501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c6b110155e4420b486c7b45f6e1b5d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.189239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c6b110155e4420b486c7b45f6e1b5d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.272978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c6b110155e4420b486c7b45f6e1b5d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:10.308498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 881/1740] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:09 2022] DELETE /identity/v3/users/17c6b110155e4420b486c7b45f6e1b5d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:10.309602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:10.314655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.349407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8122e4-fcba-483d-b471-eec521e6c2c1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:10.537679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506cd1-fe9f-424c-8e0c-b306adf065cd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:10.541022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:10.541893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:10.542221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:10.542535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:10.548782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.552247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:10.553552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:10.553942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:10.554606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:10.557338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.725707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:10.735395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ef529-dbb5-429e-8610-b4797674f6b0 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:10.786798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 882/1741] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:10.802238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f7f6-bd42-4524-a6a4-f69faabe250f None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:10.804701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f7f6-bd42-4524-a6a4-f69faabe250f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:10.805425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f7f6-bd42-4524-a6a4-f69faabe250f None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:10.815155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 883/1742] 10.222.0.57 () {54 vars in 912 bytes} [Wed May 25 14:59:10 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:10.818402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:10.830723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:10.831229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:10.831670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:10.832110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb92a1-f522-499a-ac93-30358ef16c13 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:10.867325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 860/1743] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:10.877854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:10.879074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:10.883898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:10.883898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:10.900541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.927819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 884/1744] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:10.941296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:10.944905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.969442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 861/1745] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:10.981647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:10.984082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:10.993746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:11.010263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829fa74-a126-4b1d-865e-43ceea04931c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:11.014648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159abd9e-019c-4b81-9d04-2522441ff19c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:11.019313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:11.020157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:11.025681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:11.026510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:11.027442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:11.028356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:11.029837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:11.030532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:11.047500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:11.050388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:11.053105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:11.054840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:11.062081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 862/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:11.100086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 885/1747] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:11.154338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:11.157270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:11.158888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:11.181397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d59b-a814-4ddd-a9d9-1abd81ac99d1 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:11.225289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:11.229648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:11.230330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:11.230820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:11.245158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:11.364988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:11.367001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:11.408898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86071d77-3b19-49cd-be42-20436dcb9a27 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:11.421987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:11.423614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:11.423912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:11.424178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] PATH_INFO: `/v3/projects/ae6ac27b42c948a7bd28887217ce1668` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:11.426356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:11.429176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:11.429917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6ac27b42c948a7bd28887217ce1668)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:11.432170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:11.469022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 863/1748] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:11.571566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:11.575293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:11.629955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb970d5-3683-47d4-ad5e-f4f97f0f0e8a service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:11.652359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:11.653541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:11.654612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:11.655322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] PATH_INFO: `/v3/projects/90adf482e4094f82be9f2c6a88e5ee8f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:11.658097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90adf482e4094f82be9f2c6a88e5ee8f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:11.661506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:11.774486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:11.866687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6ac27b42c948a7bd28887217ce1668', 'request_id': 'req-394a8d9b-3b60-497c-bafb-ca22f6453f26'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:11.942322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90adf482e4094f82be9f2c6a88e5ee8f', 'request_id': 'req-bf55dc30-2f45-47c5-93c1-74d82969508b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:11.970325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90adf482e4094f82be9f2c6a88e5ee8f', 'request_id': 'req-bf55dc30-2f45-47c5-93c1-74d82969508b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:11.994882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90adf482e4094f82be9f2c6a88e5ee8f', 'request_id': 'req-bf55dc30-2f45-47c5-93c1-74d82969508b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.003148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6ac27b42c948a7bd28887217ce1668', 'request_id': 'req-394a8d9b-3b60-497c-bafb-ca22f6453f26'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.016470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6ac27b42c948a7bd28887217ce1668', 'request_id': 'req-394a8d9b-3b60-497c-bafb-ca22f6453f26'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.072783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] The token cache is being invalidate because project ae6ac27b42c948a7bd28887217ce1668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:12.073136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.073878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-394a8d9b-3b60-497c-bafb-ca22f6453f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.079239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 886/1749] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:11 2022] DELETE /identity/v3/projects/ae6ac27b42c948a7bd28887217ce1668 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:12.084669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef899-e340-4244-9d6c-047fdebd74c9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.084976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef899-e340-4244-9d6c-047fdebd74c9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.085621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef899-e340-4244-9d6c-047fdebd74c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.146143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] The token cache is being invalidate because project 90adf482e4094f82be9f2c6a88e5ee8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:12.146750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.150003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.152043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 864/1750] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:11 2022] DELETE /identity/v3/projects/90adf482e4094f82be9f2c6a88e5ee8f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:12.157782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:12.161566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:12.187095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fffef899-e340-4244-9d6c-047fdebd74c9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:12.195900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fffef899-e340-4244-9d6c-047fdebd74c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:12.348930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 887/1751] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:12.360299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.361031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.362180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.380299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55dc30-2f45-47c5-93c1-74d82969508b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:12.395799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:12.396905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.397429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.399682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] PATH_INFO: `/v3/users/0b631fe3d4dd400aa85122428d47cb3f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.402276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b631fe3d4dd400aa85122428d47cb3f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:12.405591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:12.415237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:12.421535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:12.448123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 888/1752] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:12.452127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:12.493464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2bd8-1c64-4b6a-87ad-6b122dd47c60 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:12.529423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:12.530441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.534620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.534979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.535839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:12.544478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:12.548280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9293-6eb4-49d2-8e8e-ab92621bd7ce admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:12.606580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 889/1753] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:12.615619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2132c4-a078-419b-ba25-fbb6b12f06ee None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.619509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2132c4-a078-419b-ba25-fbb6b12f06ee None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.620999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2132c4-a078-419b-ba25-fbb6b12f06ee None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.633299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 890/1754] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:59:12 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:12.636036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2132c4-a078-419b-ba25-fbb6b12f06ee None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:12.688744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2132c4-a078-419b-ba25-fbb6b12f06ee None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:12.697503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b631fe3d4dd400aa85122428d47cb3f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.716910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:12.717595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.717822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.718202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.718822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:12.726518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:12.746656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b631fe3d4dd400aa85122428d47cb3f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.748251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b631fe3d4dd400aa85122428d47cb3f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.752703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b631fe3d4dd400aa85122428d47cb3f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.840826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-db88d7be-5b2d-4ec6-b1e3-facb22ff1d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b631fe3d4dd400aa85122428d47cb3f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:12.863279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 865/1755] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:12 2022] DELETE /identity/v3/users/0b631fe3d4dd400aa85122428d47cb3f => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:12.865098 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:12.865391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:12.865678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:12.908384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 891/1756] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:12 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:12.912874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:12.923767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:12.938940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:12.942943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:13.100924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d571-aea8-499e-a5cf-d813eb546aad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:13.118998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:13.119895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.120232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.120470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.121263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:13.123223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:13.303212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 892/1757] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:12 2022] POST /identity/v3/users => generated 291 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:13.304365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:13.326229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16104-0784-4c58-a84b-a0ad1fcb6b42 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:13.337979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:13.339252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.339538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.339860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.340638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:13.342898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:13.356438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 866/1758] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:13.380428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 893/1759] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:13.385655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:13.398457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:13.426327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53a9ed-9cd4-499d-8985-dadac903e1d1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:13.471080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:13.471877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.472170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.472444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.473460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:13.475990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:13.593712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:13.599595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 867/1760] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:13.616283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:13.620881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:13.637854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c8222-945e-4bab-811e-81658e28832a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:13.657367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:13.659415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.659945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.660315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] PATH_INFO: `/v3/projects/0b33282909464546bf96ac871a48d588/users/83a46f71ab4f44af96754cb317fd7195/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.706286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0902-cc12-4f17-ab46-11f1171a77fd admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:13.736823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:13.737878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.738346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.738807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.744839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b33282909464546bf96ac871a48d588, user_id=83a46f71ab4f44af96754cb317fd7195, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:13.753201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:13.837059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:13.849508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1950-19ce-4fc8-8240-e0d641fe2d38 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:13.888515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 894/1761] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:13 2022] PUT /identity/v3/projects/0b33282909464546bf96ac871a48d588/users/83a46f71ab4f44af96754cb317fd7195/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:13.889750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:13.892871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:13.908293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 868/1762] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:13.914912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:13.915213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:13.915486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:13.991195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:14.047134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] MFA Rules not processed for user `83a46f71ab4f44af96754cb317fd7195`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:14.051498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:14.186663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 869/1763] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:14.193600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:14.245902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26719d3-99be-4207-b00c-2e9ac0b25daf admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:14.268403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:14.286796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:14.288896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:14.289854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] PATH_INFO: `/v3/projects/08843ea2b3f54fc2b5494ecd04109ce3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:14.304992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08843ea2b3f54fc2b5494ecd04109ce3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:14.307975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:14.539326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f9641-b6d0-43c7-b535-939418e4deb1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:14.563620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08843ea2b3f54fc2b5494ecd04109ce3', 'request_id': 'req-2953bbfd-f795-41dd-b227-896b9a07611e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:14.663643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08843ea2b3f54fc2b5494ecd04109ce3', 'request_id': 'req-2953bbfd-f795-41dd-b227-896b9a07611e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:14.681559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08843ea2b3f54fc2b5494ecd04109ce3', 'request_id': 'req-2953bbfd-f795-41dd-b227-896b9a07611e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:14.711858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] The token cache is being invalidate because project 08843ea2b3f54fc2b5494ecd04109ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:14.712210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:14.713483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:14.717247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 895/1764] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:13 2022] DELETE /identity/v3/projects/08843ea2b3f54fc2b5494ecd04109ce3 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:14.724299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:14.727452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:14.913872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:14.914984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:14.915477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:14.915989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:14.916998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:14.919741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef74f-e056-49d6-80ab-b52215cae680 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:14.972996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bbfd-f795-41dd-b227-896b9a07611e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:14.978734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:14.979935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:14.980464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:14.981602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] PATH_INFO: `/v3/projects/b868fd6155e84f10a3046ecb54cafac1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:14.982806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b868fd6155e84f10a3046ecb54cafac1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:14.986146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:15.058272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:15.066619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 870/1765] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:14 2022] POST /identity/v3/projects => generated 379 bytes in 874 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:15.071610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:15.073279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:15.080529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:15.174819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b868fd6155e84f10a3046ecb54cafac1', 'request_id': 'req-ddaca315-5cbb-49ad-b4d9-312a12fa6662'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:15.185118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] MFA Rules not processed for user `b7885ae5d9de498d8664da4bab204987`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:15.191173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:15.295165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b868fd6155e84f10a3046ecb54cafac1', 'request_id': 'req-ddaca315-5cbb-49ad-b4d9-312a12fa6662'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:15.309728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b868fd6155e84f10a3046ecb54cafac1', 'request_id': 'req-ddaca315-5cbb-49ad-b4d9-312a12fa6662'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:15.342858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] The token cache is being invalidate because project b868fd6155e84f10a3046ecb54cafac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:15.343218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:15.345181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:15.350545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 896/1766] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:14 2022] DELETE /identity/v3/projects/b868fd6155e84f10a3046ecb54cafac1 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:15.353674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:15.356577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:15.366558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 871/1767] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:15.368158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:15.371157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:15.436640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:15.638252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0997a-355b-4a4c-89bc-a59b8f8ad903 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:15.683201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:15.684130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:15.684420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:15.684719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] PATH_INFO: `/v3/users/8f331b4fe494479ea8111a2324d83729` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:15.686116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f331b4fe494479ea8111a2324d83729)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:15.688375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:15.997289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f331b4fe494479ea8111a2324d83729'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.042278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f331b4fe494479ea8111a2324d83729'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.044546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f331b4fe494479ea8111a2324d83729'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.046158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f331b4fe494479ea8111a2324d83729'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.087281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaca315-5cbb-49ad-b4d9-312a12fa6662 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:16.120544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:16.121669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:16.122007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:16.126210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] PATH_INFO: `/v3/projects/22e0e1295a974f7c9bd2806199773dd4` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:16.129984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e0e1295a974f7c9bd2806199773dd4)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:16.146286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f331b4fe494479ea8111a2324d83729'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.162288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:16.195087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 872/1768] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:15 2022] DELETE /identity/v3/users/8f331b4fe494479ea8111a2324d83729 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:16.196129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:16.205977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:16.220387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:16.409054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401890-eada-4267-914b-eab69563c435 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:16.412346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e0e1295a974f7c9bd2806199773dd4', 'request_id': 'req-10d657cd-d777-4f60-b663-b91c8efcd7a9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.433940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:16.501244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e0e1295a974f7c9bd2806199773dd4', 'request_id': 'req-10d657cd-d777-4f60-b663-b91c8efcd7a9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.529501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e0e1295a974f7c9bd2806199773dd4', 'request_id': 'req-10d657cd-d777-4f60-b663-b91c8efcd7a9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.570831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] The token cache is being invalidate because project 22e0e1295a974f7c9bd2806199773dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:16.571186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.582697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:16.582697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 897/1769] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:15 2022] DELETE /identity/v3/projects/22e0e1295a974f7c9bd2806199773dd4 => generated 0 bytes in 1227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:16.582697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:16.584285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:16.591009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:16.594689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:16.597167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:16.598243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:16.601215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:16.614675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9462c5d-4ba6-4ecb-ac25-54a989471232 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:16.642982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d657cd-d777-4f60-b663-b91c8efcd7a9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:16.652065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:16.653453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:16.654314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:16.654782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] PATH_INFO: `/v3/users/73d4b3cdcac34a9abc5e451421f89329` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:16.657959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d4b3cdcac34a9abc5e451421f89329)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:16.661035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:16.739742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 873/1770] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:16 2022] POST /identity/v3/users => generated 296 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:16.745204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:16.745551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:16.748803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:16.842520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:16.843967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:16.886177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 874/1771] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:16.888538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:16.893423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:16.933683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7678-7aff-4fba-9002-610227d631a9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:16.952128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:16.952863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:16.953774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:16.960167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:16.960167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:16.963487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77094b0-ce9c-436b-888a-12cef890796d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:17.023899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d4b3cdcac34a9abc5e451421f89329'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:17.028213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d4b3cdcac34a9abc5e451421f89329'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:17.036942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 875/1772] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:17.041453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:17.041973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:17.042262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:17.049451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d4b3cdcac34a9abc5e451421f89329'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:17.050307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d4b3cdcac34a9abc5e451421f89329'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:17.108405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:17.112019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:17.122879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d4b3cdcac34a9abc5e451421f89329'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:17.167196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 876/1773] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:17.174189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:17.180084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:17.192124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 898/1774] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:16 2022] DELETE /identity/v3/users/73d4b3cdcac34a9abc5e451421f89329 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:17.195041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:17.245504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a8a53-cc5a-4952-bd9b-44faad0ee4a3 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:17.290074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:17.311412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:17.444931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e46d-a0ef-49de-8c66-4b343e44a72e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:17.456948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:17.458044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:17.459365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:17.459684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] PATH_INFO: `/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a/users/87c595b55b9a4d4589aa2bf85079e73e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:17.468925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:17.469982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:17.470273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:17.470634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:17.471389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:17.471705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:17.473663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:17.529686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 899/1775] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:17.538157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:17.539444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5679de95c6d47d38ac1d13f3a330a6a, user_id=87c595b55b9a4d4589aa2bf85079e73e, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:17.567313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:17.577232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0e76-7413-452b-a8d4-1a6d120b8f03 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:17.582999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:17.583790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:17.584278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:17.584731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:17.585689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:17.588851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:17.692269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 877/1776] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:17 2022] PUT /identity/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a/users/87c595b55b9a4d4589aa2bf85079e73e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:17.693855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:17.742079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 900/1777] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:17 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:17.746186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:17.965392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2273-be13-4025-8437-f4fdaf7be544 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.005516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf959f9-cdec-46f9-9842-43f317be0401 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.018373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.019764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.021902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.022258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.026409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.027671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.145553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.146282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.146862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.147153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.147996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.150646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.174551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 878/1778] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:18.177397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.205572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14902-910c-41f5-b357-f994bad4509b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.224537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 901/1779] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:17 2022] POST /identity/v3/users => generated 288 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:18.236331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.236331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.236331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.236331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] PATH_INFO: `/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a/users/87c595b55b9a4d4589aa2bf85079e73e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.236978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5679de95c6d47d38ac1d13f3a330a6a, user_id=87c595b55b9a4d4589aa2bf85079e73e, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.253196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.255775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1e85-3007-478d-b50a-568264535406 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.287324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 879/1780] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:18 2022] PUT /identity/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a/users/87c595b55b9a4d4589aa2bf85079e73e/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:18.289042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0a7c1-ad1c-4861-a0b7-a02f9e11e84e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.289137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.289386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.289678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.381523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] MFA Rules not processed for user `87c595b55b9a4d4589aa2bf85079e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:18.382820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:18.627567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.627567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.627567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.627567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.633981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.633981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.633981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 902/1781] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:18.633981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.633981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21933e3-7cb9-4fb1-8578-8be9ca2e5128 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.634854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.634854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.634854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.634854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.636220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.636220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.636562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 880/1782] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:18.637128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 903/1783] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:18.637386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.637555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.637555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:18.637713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fd1f1-993a-43fe-add7-05041f693361 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.654460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.659028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.662436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.662436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] PATH_INFO: `/v3/projects/df7705c3a21047f18be4dac62e7cddb0/users/f83461c482e0439198c010139f283d18/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.704166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7705c3a21047f18be4dac62e7cddb0, user_id=f83461c482e0439198c010139f283d18, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.733670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e50e-db75-48d8-b80c-31797417c340 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.814004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8916-8c1b-4096-9569-66663f240b25 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:18.818653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:18.819423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.819692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.819983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.835714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:18.902366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 881/1784] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:18 2022] PUT /identity/v3/projects/df7705c3a21047f18be4dac62e7cddb0/users/f83461c482e0439198c010139f283d18/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:18.906099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:18.906988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:18.907949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:18.933749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:18.938377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:18.976945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 904/1785] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:18.985819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:18.989592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:18.991549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:19.028018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] MFA Rules not processed for user `f83461c482e0439198c010139f283d18`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:19.045392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:19.071825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb4eb1-f659-493b-8202-75646e529e7a service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:19.341283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:19.342624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:19.345504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:19.346042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] PATH_INFO: `/v3/projects/83f5892fc50f4c14998594b8fe826b57` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:19.348590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f5892fc50f4c14998594b8fe826b57)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:19.351853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:19.391547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 882/1786] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:19.396984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:19.557931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6762-18f2-4eee-a593-b3bb4458982b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:19.591473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f5892fc50f4c14998594b8fe826b57', 'request_id': 'req-a59e1244-2ba3-46c1-8710-9a5d368eb241'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:19.697318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:19.699853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:19.700384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:19.701784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:19.705786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:19.746256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f5892fc50f4c14998594b8fe826b57', 'request_id': 'req-a59e1244-2ba3-46c1-8710-9a5d368eb241'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:19.755735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f5892fc50f4c14998594b8fe826b57', 'request_id': 'req-a59e1244-2ba3-46c1-8710-9a5d368eb241'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:19.780469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] The token cache is being invalidate because project 83f5892fc50f4c14998594b8fe826b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:19.781186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:19.783711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:19.790768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 905/1787] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:18 2022] DELETE /identity/v3/projects/83f5892fc50f4c14998594b8fe826b57 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:19.792038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:19.793901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:19.878486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:19.880093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150b960-e7ca-4906-839a-eabe1df44464 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:19.887826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:19.903191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 883/1788] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:19.907532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715842e-9199-4651-8de3-dd6b70e213de None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:19.907532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715842e-9199-4651-8de3-dd6b70e213de None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:19.907532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715842e-9199-4651-8de3-dd6b70e213de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:19.934099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e1244-2ba3-46c1-8710-9a5d368eb241 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:19.963142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:19.963142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:19.963142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:19.963142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:19.963549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:19.963549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:19.968489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c715842e-9199-4651-8de3-dd6b70e213de None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:19.970966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c715842e-9199-4651-8de3-dd6b70e213de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:19.980423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 884/1789] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:19.991012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:19.991829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:19.992935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.037748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:20.040367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:20.056059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 885/1790] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:20.060828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.069187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:20.078885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9d6d-7e38-440f-bd01-67ebb4d8ba3d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.087511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.088454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.089084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.089563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.090784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:20.091631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.094861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.114382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 886/1791] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:20.119396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.137088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 906/1792] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:19 2022] POST /identity/v3/projects => generated 375 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:20.142333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.162423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f298-426d-45fe-aef2-337c12346cbf admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.260694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f799-692d-44a3-bb2d-7fe66b4ac9cb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.324587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.325335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.325492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.325830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.326226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.326403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.326529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.326792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.327059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.336336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.339956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.341922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.473640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 907/1793] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:20 2022] POST /identity/v3/users => generated 294 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:59:20.476629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 887/1794] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:20 2022] POST /identity/v3/projects => generated 391 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:20.477687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.477822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.505073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145433-73c4-4f6e-b290-a98d05ef23b0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.644077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d47ea-126a-41bb-a117-6f9150e7727d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.650085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.650836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.651127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.651410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.652383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.654116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920bdcc-ee46-4c3d-8739-e32d17884789 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.684988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 888/1795] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:20.684988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.684988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.684988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.706997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] MFA Rules not processed for user `09cd0b66ae0145cb9e533335e23e2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:20.708602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:20.716873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.717918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.718209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.718486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.720441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.723272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.834029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 908/1796] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:20 2022] POST /identity/v3/users => generated 296 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:20.842167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.863514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 889/1797] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:20.864564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:20.867417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:20.881567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a1b-2624-40e5-8751-654d58faede8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.885446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512851e-43cd-4fa4-aebf-925acecbaa18 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:20.892032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.893419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.893758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.898257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] PATH_INFO: `/v3/projects/07629d829a054ccab416e905cb7523f9` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.898604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:20.898778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07629d829a054ccab416e905cb7523f9)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.898778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:20.899407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:20.900565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:20.902015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] PATH_INFO: `/v3/projects/99654ff770b84212b28f4f2c66373954/users/b1642b68d76d4e85a13b5a26383b1f5a/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:20.954100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99654ff770b84212b28f4f2c66373954, user_id=b1642b68d76d4e85a13b5a26383b1f5a, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:20.962354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.088298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 909/1798] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:20 2022] PUT /identity/v3/projects/99654ff770b84212b28f4f2c66373954/users/b1642b68d76d4e85a13b5a26383b1f5a/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:21.092023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.117330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07629d829a054ccab416e905cb7523f9', 'request_id': 'req-bdc5485e-8bf0-478f-a8a3-306fae90dc56'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:21.139140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07629d829a054ccab416e905cb7523f9', 'request_id': 'req-bdc5485e-8bf0-478f-a8a3-306fae90dc56'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:21.159125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07629d829a054ccab416e905cb7523f9', 'request_id': 'req-bdc5485e-8bf0-478f-a8a3-306fae90dc56'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:21.194906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:21.249187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d40d5-68f6-487c-a42f-9719d3d1c6d0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.258974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] The token cache is being invalidate because project 07629d829a054ccab416e905cb7523f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:21.259360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:21.261304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:21.262635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 890/1799] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:20 2022] DELETE /identity/v3/projects/07629d829a054ccab416e905cb7523f9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:21.268521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.273229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.361817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.363059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.363354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.363640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.364399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.367229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6143f1-a663-475d-b672-4fd470272c8e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.386130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 910/1800] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:21.388241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.388387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.388564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.423940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:21.425924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.441245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 911/1801] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:21.442360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.446438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.464656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5485e-8bf0-478f-a8a3-306fae90dc56 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.474009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe054c-d8bf-47b6-a013-961631a2082d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.476123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.476976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.477410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.477790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.479066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.479644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.480352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.480694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.481146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.482127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.486044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739740-f8af-4e67-8d5a-19987b32bc1d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.499177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.524947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 912/1802] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:21.529508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.532548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.533327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.534745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 891/1803] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:21.537420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.572923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247800e5-4686-44fc-8d4c-3d7b42620018 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.575644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:21.577187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.585408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.588674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.589197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.589652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] PATH_INFO: `/v3/projects/cf7ef8cd535b4cd184896878b95f5875/users/7fc6326707ab409b93677ef1a7e7b796/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.596504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 913/1804] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:21.596504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.609348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa4c21-c11d-4a1f-9ebe-35ac2a983e02 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.623129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.623514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.623803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.624401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] PATH_INFO: `/v3/projects/99654ff770b84212b28f4f2c66373954/users/b1642b68d76d4e85a13b5a26383b1f5a/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.629804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99654ff770b84212b28f4f2c66373954, user_id=b1642b68d76d4e85a13b5a26383b1f5a, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.634210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.638757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7ef8cd535b4cd184896878b95f5875, user_id=7fc6326707ab409b93677ef1a7e7b796, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.645254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1f3cd-4d85-45bb-8b61-484fabeb09ce admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.658523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 914/1805] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:21 2022] PUT /identity/v3/projects/99654ff770b84212b28f4f2c66373954/users/b1642b68d76d4e85a13b5a26383b1f5a/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:21.660108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:21.741970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 892/1806] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:21 2022] PUT /identity/v3/projects/cf7ef8cd535b4cd184896878b95f5875/users/7fc6326707ab409b93677ef1a7e7b796/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:21.743342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a70fc-1bc5-4884-9361-281707f2727a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.743640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a70fc-1bc5-4884-9361-281707f2727a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.747730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a70fc-1bc5-4884-9361-281707f2727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.790721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb058d-88e7-4171-86e2-2b69502a5b0f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:21.797167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-545a70fc-1bc5-4884-9361-281707f2727a None None] MFA Rules not processed for user `b1642b68d76d4e85a13b5a26383b1f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:21.798692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-545a70fc-1bc5-4884-9361-281707f2727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.899958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:21.900800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.900956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.901238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.905012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:21.905012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:21.905012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb0fa-de66-4fa5-a58a-887d5fb46c08 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:21.927421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 915/1807] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:21.927698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 893/1808] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:21.927698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.927698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.927698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.928371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:21.928833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:21.929124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:21.936879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:21.951490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] MFA Rules not processed for user `2e88ad2e00984607a96a3e39d35e223d`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:21.953707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:21.981874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] MFA Rules not processed for user `7fc6326707ab409b93677ef1a7e7b796`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:21.983443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:22.041045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:22.062882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 894/1809] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:22.063796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.079777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a9430-a28c-4eec-b6e3-cecc88c310b2 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.085139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.085911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.086786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.087139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.087929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.092884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.129809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 916/1810] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:22.129809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.129809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:22.196284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 895/1811] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:22 2022] POST /identity/v3/projects => generated 409 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:22.197877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.253760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b694-4869-4e03-8b8e-7b96bdc75e41 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.314426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672642-c0c6-447d-afe0-0c8296e00ae4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.319933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.321824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.322491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.323003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.324159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.326113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.341439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.342273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.342685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.343061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.347231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:22.430244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.430244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.435927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 917/1812] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:22.437070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.463799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f103b7-8ef6-4b90-a8f3-da1a72b250f9 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.466251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.466984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.467274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.469859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.470788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.475236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.494983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 896/1813] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:22 2022] POST /identity/v3/projects => generated 393 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:22.499094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.618316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 918/1814] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:22 2022] POST /identity/v3/users => generated 305 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:22.618316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.633167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312117e3-eb0b-4754-bc07-244d57e3836d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.641269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.643770 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.645011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.645671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.648043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.649968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.651220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece8ae-29ec-49c4-9936-9708624f862d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.665018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 919/1815] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:22.670587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.670587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.670587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.670587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.671390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.671846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.680720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.685814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326965d6-ad9a-4b89-b2c1-4708ae26e271 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.696498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.697381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.697680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.697972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.700826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.709828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.744185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 920/1816] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:22.745513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.772456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d729f-ca2f-4f74-8e8c-eaa656cd4b3c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.787671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.789559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.789559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.789559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] PATH_INFO: `/v3/projects/cdd3591a7ddc4d0084c72a57cafd1b33/users/ccd9b114e6c0435c9e6d385a83941f84/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.809702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 897/1817] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:22 2022] POST /identity/v3/users => generated 303 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:22.812999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd3591a7ddc4d0084c72a57cafd1b33, user_id=ccd9b114e6c0435c9e6d385a83941f84, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.817457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.822084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4b09c-3298-40b1-865d-4d9141363d07 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.848247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971795-aefc-4e4c-8cba-09f1dfc9f079 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.868523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:22.870103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.870303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.870692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.871656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:22.873695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:22.895586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 898/1818] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:22.897745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:22.929445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002a819-573e-4f29-8786-947704a38ca3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:22.941657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 921/1819] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:22 2022] PUT /identity/v3/projects/cdd3591a7ddc4d0084c72a57cafd1b33/users/ccd9b114e6c0435c9e6d385a83941f84/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:59:22.943709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:22.944011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:22.944296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:22.977191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] MFA Rules not processed for user `ccd9b114e6c0435c9e6d385a83941f84`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:22.978900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:23.074241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.076021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.076559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.077207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] PATH_INFO: `/v3/projects/0c12c001f4354d32a8936047bccf8bd2/users/9dd140fdd01045fbb6d31428bc38719c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.080817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 922/1820] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:23.100559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.119829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde35a-f405-44eb-9312-f28f9b2ae840 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.127215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.128682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.129426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.129792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.131202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.134461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.169947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c12c001f4354d32a8936047bccf8bd2, user_id=9dd140fdd01045fbb6d31428bc38719c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.174757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.230828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:23.266948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 899/1821] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:22 2022] PUT /identity/v3/projects/0c12c001f4354d32a8936047bccf8bd2/users/9dd140fdd01045fbb6d31428bc38719c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:23.271094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.341651 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 923/1822] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:23 2022] POST /identity/v3/projects => generated 407 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:23.343029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.402530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a22074-5283-438b-9224-005c38a84454 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.500197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67af4-cd7e-47d6-9d85-7242177547b0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.517979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.519172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.519690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.537343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.538765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.541712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.545925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.545925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.546100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.546192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.546192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.546192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.564388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 900/1823] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:23.569609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.585413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92d102-a929-4589-9a1c-9580b5f4a0f2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.600043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.601069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.601265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.601545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] PATH_INFO: `/v3/projects/0c12c001f4354d32a8936047bccf8bd2/users/9dd140fdd01045fbb6d31428bc38719c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.604960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c12c001f4354d32a8936047bccf8bd2, user_id=9dd140fdd01045fbb6d31428bc38719c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.607626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a80bd-a3fd-43b4-b18e-314928bda482 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.644863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 901/1824] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:23 2022] PUT /identity/v3/projects/0c12c001f4354d32a8936047bccf8bd2/users/9dd140fdd01045fbb6d31428bc38719c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:23.646622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.646925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.647292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.652667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 924/1825] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:23 2022] POST /identity/v3/users => generated 310 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:23.661486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.678764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fb42-179a-44a9-865d-02a5a443bfa2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.687429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:23.699082 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] MFA Rules not processed for user `9dd140fdd01045fbb6d31428bc38719c`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:23.701304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:23.934014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.934014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.934014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.934014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.934798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.934798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:23.934798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 925/1826] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:23.934798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.935174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 902/1827] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:23.935174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:23.935602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3293f4-24a3-4f39-9e86-3b3f984b3cb8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:23.935602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:23.935602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:23.935602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:23.936091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] PATH_INFO: `/v3/projects/69490227a80c49b69082303c03193b5b/users/2a6b12e480a7443c89e789de64419ef2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:23.949998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69490227a80c49b69082303c03193b5b, user_id=2a6b12e480a7443c89e789de64419ef2, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:23.955665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:24.002941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e0065-6f69-418e-a5aa-d1ec64d233af None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:24.007580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:24.008360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:24.008954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:24.009404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:24.020285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:24.021834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:24.034537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 903/1828] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:24.119111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:24.120763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:24.133408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8a84-24ac-4fdb-ba98-9b1e361c4819 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:24.137639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:24.138367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:24.138654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:24.138935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:24.217870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:24.220160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:24.239146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 904/1829] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:25.118953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 926/1830] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:23 2022] PUT /identity/v3/projects/69490227a80c49b69082303c03193b5b/users/2a6b12e480a7443c89e789de64419ef2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 1258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:25.122997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:25.137732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969641-777f-402b-9d68-7bca371925d9 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:25.218584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:25.220445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:25.220806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:25.221267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:25.222139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:25.223918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6840-5c8b-4c24-9362-6bf830f79e87 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:25.237258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 905/1831] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:25.241663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:25.255721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45f01-1c4b-498b-a377-317b6fba212c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:25.265043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:25.266807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:25.268015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:25.268015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] PATH_INFO: `/v3/projects/69490227a80c49b69082303c03193b5b/users/2a6b12e480a7443c89e789de64419ef2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:25.270278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69490227a80c49b69082303c03193b5b, user_id=2a6b12e480a7443c89e789de64419ef2, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:25.274852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:25.300714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 927/1832] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:25 2022] PUT /identity/v3/projects/69490227a80c49b69082303c03193b5b/users/2a6b12e480a7443c89e789de64419ef2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:25.301894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:25.302198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:25.302550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:25.335395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] MFA Rules not processed for user `2a6b12e480a7443c89e789de64419ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:25.336516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:25.488586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 906/1833] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:25.768280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:25.831979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03f840-3b00-4d93-847b-2b9754925646 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:25.837507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:25.838368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:25.838830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:25.839259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:25.852425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:25.854405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:25.865834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 928/1834] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:26.259544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:26.592521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:26.604662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44e7b-6793-4467-b2e8-e0bc84c63a22 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:26.608905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:26.610963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:26.610963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:26.610963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:26.700804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:26.702549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6e54a-f89f-4c72-958f-6fd848070cb0 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:26.724883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 907/1835] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:27.083675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:27.635254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:28.284151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:28.533069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:29.177338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:39.009364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:39.019954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa0b7e-faff-4fd0-8f31-98a5b648e4d7 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:39.024446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:39.025256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.025616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.025971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.112376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:39.114588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abac34-2572-40b4-a967-64ceb1d373c0 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:39.126763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 929/1836] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:39.180273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.180777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.180878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.182834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 908/1837] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:39.190826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.191120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.191406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.212979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:39.214334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:39.254141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=75 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:39.293705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 930/1838] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:39.315943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:39.317792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:39.341861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fe85-54d1-4b29-a6e0-c111c75ffcf1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:39.352316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:39.353213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.353570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.353952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.381309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:39.384902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d326-15f0-41d2-91be-9cbed98918d9 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:39.406170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 909/1839] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:40.926993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:41.011805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ac1f9-e23e-423f-b7e7-b98baaa71ea0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:41.017143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:41.018079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:41.018393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:41.018675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] PATH_INFO: `/v3/users/7fc6326707ab409b93677ef1a7e7b796` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:41.019879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc6326707ab409b93677ef1a7e7b796)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:41.021883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:41.170979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:41.276418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc6326707ab409b93677ef1a7e7b796'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:41.277141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc6326707ab409b93677ef1a7e7b796'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:41.287160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc6326707ab409b93677ef1a7e7b796'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:41.287898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc6326707ab409b93677ef1a7e7b796'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:41.397090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc6326707ab409b93677ef1a7e7b796'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:41.417186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 931/1840] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:40 2022] DELETE /identity/v3/users/7fc6326707ab409b93677ef1a7e7b796 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:41.423634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:41.424170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:41.424278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:41.442248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:41.443654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:41.509508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 910/1841] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:41.520868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:41.522221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:41.587063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992538-f81a-43c0-ba4f-4155712dec2c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:41.594177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:41.594903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:41.595293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:41.595666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:41.610961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:41.612513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:41.623635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 932/1842] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:42.190726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:42.192216 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:42.207994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cee527-6d4a-48c4-9894-6e3c72ef0e04 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:42.215096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:42.219288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:42.219288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:42.219288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] PATH_INFO: `/v3/projects/cf7ef8cd535b4cd184896878b95f5875` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:42.219288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7ef8cd535b4cd184896878b95f5875)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:42.221248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:42.366033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7ef8cd535b4cd184896878b95f5875', 'request_id': 'req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.375171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7ef8cd535b4cd184896878b95f5875', 'request_id': 'req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.380535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7ef8cd535b4cd184896878b95f5875', 'request_id': 'req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.457818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] The token cache is being invalidate because project cf7ef8cd535b4cd184896878b95f5875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:42.458526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.458768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.460364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 911/1843] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:42 2022] DELETE /identity/v3/projects/cf7ef8cd535b4cd184896878b95f5875 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:42.472275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:42.485344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6aba5-d8d2-4790-a4aa-83310b2d1fbf service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:42.554976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:42.555881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:42.556224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:42.556416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] PATH_INFO: `/v3/users/9dd140fdd01045fbb6d31428bc38719c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:42.559526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd140fdd01045fbb6d31428bc38719c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:42.560741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:42.752498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd140fdd01045fbb6d31428bc38719c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.753498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd140fdd01045fbb6d31428bc38719c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.756541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:42.768557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd140fdd01045fbb6d31428bc38719c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.769461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd140fdd01045fbb6d31428bc38719c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.840366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84e09f77-71a4-44fe-86d5-aec1909ae4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd140fdd01045fbb6d31428bc38719c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:42.862075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 933/1844] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:42 2022] DELETE /identity/v3/users/9dd140fdd01045fbb6d31428bc38719c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:43.322135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:43.323677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.339160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b8ce-5d79-48e1-8af6-ef08e2ec0232 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:43.410325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:43.411265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.411560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.411958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] PATH_INFO: `/v3/projects/0c12c001f4354d32a8936047bccf8bd2` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.413213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c12c001f4354d32a8936047bccf8bd2)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:43.415144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:43.428410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:43.551618 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c12c001f4354d32a8936047bccf8bd2', 'request_id': 'req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:43.557928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c12c001f4354d32a8936047bccf8bd2', 'request_id': 'req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:43.563564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c12c001f4354d32a8936047bccf8bd2', 'request_id': 'req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:43.661846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] The token cache is being invalidate because project 0c12c001f4354d32a8936047bccf8bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:43.662342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:43.663346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ca297eeb-694a-4829-8bfc-ffbf6d73e5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:43.665820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 912/1845] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:43 2022] DELETE /identity/v3/projects/0c12c001f4354d32a8936047bccf8bd2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:43.671747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec435-69ac-4583-bcda-73168374075b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.672241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec435-69ac-4583-bcda-73168374075b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.672751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec435-69ac-4583-bcda-73168374075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.695818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-be3ec435-69ac-4583-bcda-73168374075b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:43.697142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-be3ec435-69ac-4583-bcda-73168374075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.777015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 934/1846] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:43.786376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.786671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.786955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.809921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:43.811388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.820754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 913/1847] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:43.826945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ec435-69ac-4583-bcda-73168374075b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:43.837454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ec435-69ac-4583-bcda-73168374075b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:43.842307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:43.842992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.843305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.843587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.844546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:43.845015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:43.846665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:43.860475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 935/1848] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:43.865139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:43.875331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982217f-a5a4-478a-ad79-4da9f3c26360 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:43.880800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:43.881405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.881690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.881971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.882695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:43.884681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:43.987095 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 914/1849] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:43.991966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.004229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad607-9125-422c-9d8b-bd4dc1808255 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.089898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.090681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.090931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.091176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.091905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.094117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.212119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 936/1850] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:44.216020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.227367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26f7c-1070-4ee6-b1bc-c728afecb86f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.237413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.238142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.238434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.238714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.239460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.241133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.252851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 915/1851] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:44.256880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.268701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e256e-8c58-4574-be10-6809acf79212 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.273791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.274456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.274740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.275022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.275764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.277401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06fa5-4c85-4113-bdf9-8f362a18dee7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.289951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 937/1852] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:44.294130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.304642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614f01a-5c52-4bf5-82af-db28bf482c83 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.310898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.311781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.312731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.313014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] PATH_INFO: `/v3/projects/11d004bc09cd476a8808d7a8e67703b6/users/eba3a4ba749d4b6bbe63cef978647a9b/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.328845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d004bc09cd476a8808d7a8e67703b6, user_id=eba3a4ba749d4b6bbe63cef978647a9b, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.331558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.461592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 916/1853] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:44 2022] PUT /identity/v3/projects/11d004bc09cd476a8808d7a8e67703b6/users/eba3a4ba749d4b6bbe63cef978647a9b/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:44.480534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.480860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.481147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.516793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] MFA Rules not processed for user `eba3a4ba749d4b6bbe63cef978647a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:44.527581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:44.543605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.607036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 938/1854] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:44.613542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.686804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d5c5-aad0-4ce2-bcbe-fa05a770a65d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.692465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.693040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.693338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.693622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.694347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.698068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.819527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 917/1855] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:44.820955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.840974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5a2d-ff27-4397-b07d-0aef626cfd17 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.918114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.918834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.919114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.919383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.920089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.923004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.004593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 939/1856] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:45.008936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.020872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a405-5336-4136-a135-5cdc13b65175 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.026749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.027462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.027745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.028022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.028791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.030455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.043898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 918/1857] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:45.052527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.066135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076574d8-3691-41f1-b271-92ce1e91a1c8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.073339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.073339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.073339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.073339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] PATH_INFO: `/v3/projects/3e971e5060fd434e879b085147bd09e7/users/21bcef6eca514792a1248d4f4b0fdd57/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.096967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e971e5060fd434e879b085147bd09e7, user_id=21bcef6eca514792a1248d4f4b0fdd57, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.098128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.208459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 940/1858] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:45 2022] PUT /identity/v3/projects/3e971e5060fd434e879b085147bd09e7/users/21bcef6eca514792a1248d4f4b0fdd57/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:45.212248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.232733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2a11-cc50-426d-ac7d-ac457e0c272d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.271562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.363980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.364752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.365167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.365610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.367449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.369198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce96aa-5836-4da9-b310-8cdcd8728457 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.389788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 919/1859] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:45.392858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.404064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61496cda-12dc-4a22-91e3-b839ad96b14e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.413296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.413296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.413296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.413296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] PATH_INFO: `/v3/projects/3e971e5060fd434e879b085147bd09e7/users/21bcef6eca514792a1248d4f4b0fdd57/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.415970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e971e5060fd434e879b085147bd09e7, user_id=21bcef6eca514792a1248d4f4b0fdd57, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.418864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.457475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 941/1860] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:45 2022] PUT /identity/v3/projects/3e971e5060fd434e879b085147bd09e7/users/21bcef6eca514792a1248d4f4b0fdd57/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:45.474497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.474979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.475492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.550433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] MFA Rules not processed for user `21bcef6eca514792a1248d4f4b0fdd57`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:45.551811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:45.667709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 920/1861] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:59:45.677583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.682224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:45.777430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65334d8-510e-4e3c-90e5-9636cab419eb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.781550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.782204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.782596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.782884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.792447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.795434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b68c2-4bab-4684-bbed-615fe815af71 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.804727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 942/1862] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:46.582111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:46.682284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9771bd-ef0c-4849-9b3e-42456344a67b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:46.685998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:46.687467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:46.688376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:46.688376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] PATH_INFO: `/v3/users/eba3a4ba749d4b6bbe63cef978647a9b` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:46.690142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba3a4ba749d4b6bbe63cef978647a9b)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:46.692880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:46.900925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:46.917090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba3a4ba749d4b6bbe63cef978647a9b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:46.938871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba3a4ba749d4b6bbe63cef978647a9b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:46.939925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba3a4ba749d4b6bbe63cef978647a9b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:46.940570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba3a4ba749d4b6bbe63cef978647a9b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:47.019371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba3a4ba749d4b6bbe63cef978647a9b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:47.034805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 921/1863] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:46 2022] DELETE /identity/v3/users/eba3a4ba749d4b6bbe63cef978647a9b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:47.039899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.040377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.040496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.062964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:47.063152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:47.084428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:47.159760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 943/1864] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:47.170769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:47.172375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:47.254257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bcc58-c003-430c-9b19-f5eb4fcfc37d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:47.260445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:47.261166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.262089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.262089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.274622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:47.276090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:47.290617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 922/1865] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:47.871226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:47.873094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:47.889005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19390-13a9-4e7d-883d-6b6807755150 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:47.894982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:47.896066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.896355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.898349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] PATH_INFO: `/v3/projects/11d004bc09cd476a8808d7a8e67703b6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.898349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d004bc09cd476a8808d7a8e67703b6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:47.900133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.009296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d004bc09cd476a8808d7a8e67703b6', 'request_id': 'req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.085820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d004bc09cd476a8808d7a8e67703b6', 'request_id': 'req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.094564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d004bc09cd476a8808d7a8e67703b6', 'request_id': 'req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.109734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] The token cache is being invalidate because project 11d004bc09cd476a8808d7a8e67703b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:48.110119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.110820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.112562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 944/1866] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:47 2022] DELETE /identity/v3/projects/11d004bc09cd476a8808d7a8e67703b6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:48.117264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.128847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525d8d-5f5b-4d86-a516-e20134e75ef2 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.191881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.192814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.193100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.193411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] PATH_INFO: `/v3/users/21bcef6eca514792a1248d4f4b0fdd57` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.194663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bcef6eca514792a1248d4f4b0fdd57)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.196774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.338835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bcef6eca514792a1248d4f4b0fdd57'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.350334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:48.356491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bcef6eca514792a1248d4f4b0fdd57'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.357389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bcef6eca514792a1248d4f4b0fdd57'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.358036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bcef6eca514792a1248d4f4b0fdd57'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.446034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5be2a772-f911-4256-bb15-2085d2ce704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bcef6eca514792a1248d4f4b0fdd57'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:48.460811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 923/1867] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:48 2022] DELETE /identity/v3/users/21bcef6eca514792a1248d4f4b0fdd57 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:48.941627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.943266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:48.958051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d4ab1-207b-41b9-8e12-fd6ab1f614cb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.025330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.026221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.026509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.026797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] PATH_INFO: `/v3/projects/3e971e5060fd434e879b085147bd09e7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.027999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e971e5060fd434e879b085147bd09e7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.029994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.153113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:49.159716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e971e5060fd434e879b085147bd09e7', 'request_id': 'req-a3583830-aecf-4915-ba3b-b7128769a84c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:49.270772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e971e5060fd434e879b085147bd09e7', 'request_id': 'req-a3583830-aecf-4915-ba3b-b7128769a84c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:49.277671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e971e5060fd434e879b085147bd09e7', 'request_id': 'req-a3583830-aecf-4915-ba3b-b7128769a84c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:49.289408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] The token cache is being invalidate because project 3e971e5060fd434e879b085147bd09e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:49.289685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:49.290358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a3583830-aecf-4915-ba3b-b7128769a84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:49.291930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 945/1868] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:48 2022] DELETE /identity/v3/projects/3e971e5060fd434e879b085147bd09e7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:49.297000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.297525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.297814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.318964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:49.320212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:49.385996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 924/1869] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:49.397076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.397584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.398046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.420403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:49.422228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:49.430366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 946/1870] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:49.434704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.445891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377d8a9-4d08-441d-a02a-787c3b3ac643 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.450485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.451166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.451437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.451720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.452785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:49.453172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.454839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.467138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 925/1871] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:49.471576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.480927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72bc6-f8b7-4216-af25-ea3e188c92ce None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.486331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.487024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.487311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.487592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.488309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.490324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.590739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 947/1872] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:49.595213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.606784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0a0c7-6b44-4c55-b73d-0945aef94cf0 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.718908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.721103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.721103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.721103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.721998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.723478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.806187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 926/1873] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:49 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:59:49.815779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.831315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb64d0-4624-4afa-a9da-b8ebfd1d6f0f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.839097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.840184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.840810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.841281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.842571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.848715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.859890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 948/1874] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:49.864453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.875604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae21d12-e75d-4c24-a160-3b6d96b01719 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.880511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.881212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.881497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.881774 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.882502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.884096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffe8ec-fd52-4d92-9f1f-93b6ae58207f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:49.896024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 927/1875] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:49.900293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:49.910467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77aae-3818-4583-bf6a-a8ac0e8de3ce admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:49.915199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:49.916085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:49.916369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:49.916673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] PATH_INFO: `/v3/projects/847c92b12aa94e54868fae8afbab40c0/users/c62b690fcb0e4847904d13943924327b/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:49.933130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847c92b12aa94e54868fae8afbab40c0, user_id=c62b690fcb0e4847904d13943924327b, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:49.935849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:50.037992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 949/1876] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:49 2022] PUT /identity/v3/projects/847c92b12aa94e54868fae8afbab40c0/users/c62b690fcb0e4847904d13943924327b/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:50.048285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.048576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.049036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.084698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] MFA Rules not processed for user `c62b690fcb0e4847904d13943924327b`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:50.085381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:50.117466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:50.164384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 928/1877] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:50.168993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:50.243322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01a0d-110a-4351-94cc-48c388e6bd38 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:50.249182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:50.250613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.250907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.251231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.251954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:50.253907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:50.338563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 950/1878] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:50 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:50.342676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:50.354806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b34d51-15ac-481e-8c0c-27b980b6ad10 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:50.430953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:50.431736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.432026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.432334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.433129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:50.435154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:50.978897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 929/1879] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:50 2022] POST /identity/v3/users => generated 299 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:50.985555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:50.997360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b7f3-5bd9-4046-86b9-4f8bc85dee6b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.005363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.006054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.006340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.006614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.007431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.009108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.022388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 951/1880] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:51.026980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:51.043056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5581-6c37-4a71-8d55-47abc57c1330 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.050579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.051712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.052005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.052332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] PATH_INFO: `/v3/projects/2c15a09ab92940c89442626fbca4eddd/users/e183475108494da09c09b47b54277553/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.072864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c15a09ab92940c89442626fbca4eddd, user_id=e183475108494da09c09b47b54277553, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.075703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.165598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 930/1881] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:51 2022] PUT /identity/v3/projects/2c15a09ab92940c89442626fbca4eddd/users/e183475108494da09c09b47b54277553/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:51.172177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:51.185720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c93c-b944-4629-81f8-9e89230381da admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.261897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:51.310183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.311606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.313261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.315643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.316493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.320036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b4402-abc2-4cb9-a3bd-46896978d48e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.341109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 952/1882] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:51.343644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:51.358744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a9b4f-2725-49b9-99c3-a7113fbe531f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.366740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.368234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.368714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.369153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] PATH_INFO: `/v3/projects/2c15a09ab92940c89442626fbca4eddd/users/e183475108494da09c09b47b54277553/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.373439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c15a09ab92940c89442626fbca4eddd, user_id=e183475108494da09c09b47b54277553, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.378885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.396193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 931/1883] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:51 2022] PUT /identity/v3/projects/2c15a09ab92940c89442626fbca4eddd/users/e183475108494da09c09b47b54277553/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:51.408863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d04f-00a9-44e0-a290-a3649e42b770 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.413330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d04f-00a9-44e0-a290-a3649e42b770 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.413330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d04f-00a9-44e0-a290-a3649e42b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.445401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-63f6d04f-00a9-44e0-a290-a3649e42b770 None None] MFA Rules not processed for user `e183475108494da09c09b47b54277553`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:51.446630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-63f6d04f-00a9-44e0-a290-a3649e42b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:51.556883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 953/1884] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:51.575193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:51.592305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:51.739908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11de35-786b-4ba3-8d2c-e65cb0356831 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.755014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.755014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.755014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.755014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.846865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:51.878626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.880133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d3d86-58c5-4e11-af8b-54942380b30f service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.891392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 932/1885] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:52.344407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:52.345335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:52.345335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:52.347430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 954/1886] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 14:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:52.354241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:52.354686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:52.355226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:52.385739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:52.387197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:52.495396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 933/1887] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:52.505610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:52.507364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:52.528172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358a36-182f-455f-b277-e79a9ced7202 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:52.536251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:52.537406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:52.541233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:52.541233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:52.551399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:52.553074 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857711a3-6b89-4ace-b2b2-bdde5cc23125 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:52.583391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 955/1888] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:53.605552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:53.607021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:53.719128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4087e-f72f-4859-a5b4-b375e1615f40 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:53.724366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:53.725298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:53.725581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:53.725856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] PATH_INFO: `/v3/users/83a46f71ab4f44af96754cb317fd7195` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:53.727360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a46f71ab4f44af96754cb317fd7195)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:53.729443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:53.975092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a46f71ab4f44af96754cb317fd7195'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:54.006192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a46f71ab4f44af96754cb317fd7195'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:54.007243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a46f71ab4f44af96754cb317fd7195'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:54.007905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a46f71ab4f44af96754cb317fd7195'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:54.012740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:54.120957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a46f71ab4f44af96754cb317fd7195'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:54.136878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 934/1889] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:53 2022] DELETE /identity/v3/users/83a46f71ab4f44af96754cb317fd7195 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:54.143071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.143591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.143935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.168903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:54.170135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.255872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 956/1890] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:54.263155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.267479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.344959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d1e7-c058-4a8a-8285-3fd590975b16 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:54.348792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:54.349558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.349842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.350129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.361114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:54.366616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:54.376648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 935/1891] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:59:54.969004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.972183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.990550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce34b3-dc54-4133-98d4-6795a90f32a3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.004818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.005916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.006287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.006710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] PATH_INFO: `/v3/projects/0b33282909464546bf96ac871a48d588` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.008018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b33282909464546bf96ac871a48d588)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.010320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.147661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.150484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b33282909464546bf96ac871a48d588', 'request_id': 'req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.231747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b33282909464546bf96ac871a48d588', 'request_id': 'req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.240161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b33282909464546bf96ac871a48d588', 'request_id': 'req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.251940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] The token cache is being invalidate because project 0b33282909464546bf96ac871a48d588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:55.252150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.252876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.254919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 957/1892] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:54 2022] DELETE /identity/v3/projects/0b33282909464546bf96ac871a48d588 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:55.259045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.270047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360af46-e2ae-4c6f-a819-af754f3f863f service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.335046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.335900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.336197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.336480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] PATH_INFO: `/v3/users/87c595b55b9a4d4589aa2bf85079e73e` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.337765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c595b55b9a4d4589aa2bf85079e73e)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.339915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.678334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c595b55b9a4d4589aa2bf85079e73e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.696014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c595b55b9a4d4589aa2bf85079e73e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.696855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c595b55b9a4d4589aa2bf85079e73e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.697476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c595b55b9a4d4589aa2bf85079e73e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.794513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d30aa160-4434-4f88-b60a-f110235fedd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c595b55b9a4d4589aa2bf85079e73e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:55.810008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 936/1893] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 14:59:55 2022] DELETE /identity/v3/users/87c595b55b9a4d4589aa2bf85079e73e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:56.408357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.410459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:56.426008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2b41-2d3b-417a-8c4c-6e7b865f86ac admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.493765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.494725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.495031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.495385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] PATH_INFO: `/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.496590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5679de95c6d47d38ac1d13f3a330a6a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.498621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.605403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5679de95c6d47d38ac1d13f3a330a6a', 'request_id': 'req-d6afc841-6d86-47cc-ae29-5008e2cd58f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:56.711015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5679de95c6d47d38ac1d13f3a330a6a', 'request_id': 'req-d6afc841-6d86-47cc-ae29-5008e2cd58f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:56.718777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5679de95c6d47d38ac1d13f3a330a6a', 'request_id': 'req-d6afc841-6d86-47cc-ae29-5008e2cd58f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:56.739439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] The token cache is being invalidate because project b5679de95c6d47d38ac1d13f3a330a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:59:56.740134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:56.741402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d6afc841-6d86-47cc-ae29-5008e2cd58f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:59:56.747204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 958/1894] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 14:59:56 2022] DELETE /identity/v3/projects/b5679de95c6d47d38ac1d13f3a330a6a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:56.749325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.753836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.753836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.775885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:56.777139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:56.783123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.843723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 937/1895] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:56.851635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.851928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.852208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.871926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:56.873231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:56.883220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 959/1896] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:56.891295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.901285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ddf8-517d-4235-ac5b-5f3c884191f2 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.907336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.908006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.908297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.908579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.909357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:56.909668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.911345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.924776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 938/1897] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.935574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.945323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82d138-a5a1-4ecf-a7bd-7b9a49db1211 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.950105 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.950776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.951065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.951352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.952056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.954567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.068163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 960/1898] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:56 2022] POST /identity/v3/projects => generated 355 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:57.072741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.084097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499efe-3a67-45aa-b275-598e229cbf7e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.149155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.149847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.150166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.150477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.151246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.153238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.259770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 939/1899] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:57 2022] POST /identity/v3/users => generated 278 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:57.263976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.275855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8896-9b7f-4690-b056-1f35f6dc012f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.282038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.282766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.283058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.283344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.286011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.288394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.308098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 961/1900] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:57.311275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.329678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca06a-5715-49a8-8b11-fd12dad5e866 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.334784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.335490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.335779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.336066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.336854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.338500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f67938-3191-4c88-b65b-a3f8601c64eb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.352027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 940/1901] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:57.357799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.369149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2666-8dba-4806-84ea-6a03bc7f7926 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.380300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.383215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.383215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.383215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] PATH_INFO: `/v3/projects/882fe602ca5149dbba9af29c93c34272/users/771a2d92bf0a4a4890677b9972b9ff91/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.400505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882fe602ca5149dbba9af29c93c34272, user_id=771a2d92bf0a4a4890677b9972b9ff91, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.404589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.510112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:57.516091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 962/1902] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:57 2022] PUT /identity/v3/projects/882fe602ca5149dbba9af29c93c34272/users/771a2d92bf0a4a4890677b9972b9ff91/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:59:57.539099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.539404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.539673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.567809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] MFA Rules not processed for user `771a2d92bf0a4a4890677b9972b9ff91`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:57.569092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:57.640781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 941/1903] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:57.645591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.728643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0d09-4362-46e3-9e44-244065815505 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.734070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.734744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.735028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.735309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.736016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.738108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.859742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 963/1904] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 14:59:57 2022] POST /identity/v3/projects => generated 357 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:57.861074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.868101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:57.872145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6065fb-c523-40d2-90cc-065d6e08ca09 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.934154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.934844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.935181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.935472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.936259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.938857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.049436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 942/1905] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 14:59:57 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:58.053638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.065667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3abd4e-87fb-4fbf-832d-9e36536a1701 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.070628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.071338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.071628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.071914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.072713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.074456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.087030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 964/1906] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:59:58.091289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.102154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d223-a440-4dd7-8bac-c53e4984f18b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.106675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.107578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.107877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.108164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] PATH_INFO: `/v3/projects/3a5abac4ae284058b12aea856b37abbe/users/f32d60215da9474a949e11a1f02a6eba/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.124865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5abac4ae284058b12aea856b37abbe, user_id=f32d60215da9474a949e11a1f02a6eba, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.127755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.204085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 943/1907] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:58 2022] PUT /identity/v3/projects/3a5abac4ae284058b12aea856b37abbe/users/f32d60215da9474a949e11a1f02a6eba/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:58.208324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.219860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888dee-4e56-4c60-a477-4d0d19e94036 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.289154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.289920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.290301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.290671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.291505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.293262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025fc04-7775-453c-a136-a38b8371e257 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.304760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 965/1908] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 14:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:59:58.309046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.320223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81aa00-332c-48c9-8e80-6358f35c9394 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.324904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.325794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.326084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.326365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] PATH_INFO: `/v3/projects/3a5abac4ae284058b12aea856b37abbe/users/f32d60215da9474a949e11a1f02a6eba/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.328913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5abac4ae284058b12aea856b37abbe, user_id=f32d60215da9474a949e11a1f02a6eba, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.331582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.342099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 944/1909] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 14:59:58 2022] PUT /identity/v3/projects/3a5abac4ae284058b12aea856b37abbe/users/f32d60215da9474a949e11a1f02a6eba/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:59:58.361290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.361584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.361864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.392357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] MFA Rules not processed for user `f32d60215da9474a949e11a1f02a6eba`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:58.393714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:58.459210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:58.469997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 966/1910] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:59:58.481437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.484918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:58.583587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53339-f249-4695-a1e1-0ac8fc44d277 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.583587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.583587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.583587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.583994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.591981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.593609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.606083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 945/1911] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:59:58.790607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:58.801160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a1a5-71d9-4efd-9e5a-6bc066b578c6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:58.804878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:58.805542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:58.805830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:58.806110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:58.872570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:58.874719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238654a-2d34-40b2-9c8a-598889a77ef5 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:58.884349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 967/1912] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:04.303448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.304959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:04.386453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.442142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119a0-a123-4c27-9f42-9bf3ae50a889 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:04.449718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:04.450796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.451328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.451692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] PATH_INFO: `/v3/users/ccd9b114e6c0435c9e6d385a83941f84` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.458020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd9b114e6c0435c9e6d385a83941f84)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:04.458020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:04.735062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd9b114e6c0435c9e6d385a83941f84'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:04.749007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd9b114e6c0435c9e6d385a83941f84'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:04.750523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd9b114e6c0435c9e6d385a83941f84'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:04.750719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd9b114e6c0435c9e6d385a83941f84'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:04.838609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd9b114e6c0435c9e6d385a83941f84'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:04.854791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 946/1913] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:04 2022] DELETE /identity/v3/users/ccd9b114e6c0435c9e6d385a83941f84 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:04.860269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.860825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.860916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.879145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:04.880467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:04.951814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 968/1914] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:04.963554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.965221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:05.069600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ff43-6437-4998-b85b-15466364a5fc admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.073155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.073812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.074101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.074385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.085426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.086906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.097793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 947/1915] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:05.725402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.726912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:05.758118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ab04c-57cc-483a-9335-77a1ee2daac2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.766398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.767341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.767632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.767908 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] PATH_INFO: `/v3/projects/cdd3591a7ddc4d0084c72a57cafd1b33` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.769252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd3591a7ddc4d0084c72a57cafd1b33)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.771789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.842301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.844220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:05.849615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.905889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f61-f8b6-4d2d-ad03-06c4e82a22bf service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.913349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd3591a7ddc4d0084c72a57cafd1b33', 'request_id': 'req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:05.982034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.983046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.987124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.987474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.989795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:06.049093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd3591a7ddc4d0084c72a57cafd1b33', 'request_id': 'req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.058283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd3591a7ddc4d0084c72a57cafd1b33', 'request_id': 'req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.067977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.069561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.070028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] The token cache is being invalidate because project cdd3591a7ddc4d0084c72a57cafd1b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:06.070321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.070976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.072534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 969/1916] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:05 2022] DELETE /identity/v3/projects/cdd3591a7ddc4d0084c72a57cafd1b33 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:06.076390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.078401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:06.080785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 948/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:06.090245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.163738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb0a68-b4e9-41b3-acb9-3e8fccf499e1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.168911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.169788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.170098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.170529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] PATH_INFO: `/v3/users/2a6b12e480a7443c89e789de64419ef2` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.174041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6b12e480a7443c89e789de64419ef2)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.175884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.435662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6b12e480a7443c89e789de64419ef2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.437224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6b12e480a7443c89e789de64419ef2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.446095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6b12e480a7443c89e789de64419ef2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.446798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6b12e480a7443c89e789de64419ef2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.591283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-3a1e2d15-d6ba-4aff-8b3e-fd6e1ca6ef20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6b12e480a7443c89e789de64419ef2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:06.613648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 970/1918] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:06 2022] DELETE /identity/v3/users/2a6b12e480a7443c89e789de64419ef2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:07.113676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.126045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70b9c-f20b-4cbd-9644-d49f7782542e service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.206541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.212379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.212379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.212379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] PATH_INFO: `/v3/projects/69490227a80c49b69082303c03193b5b` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.212379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69490227a80c49b69082303c03193b5b)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.212768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.227281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.368697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69490227a80c49b69082303c03193b5b', 'request_id': 'req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:07.376059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69490227a80c49b69082303c03193b5b', 'request_id': 'req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:07.387787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69490227a80c49b69082303c03193b5b', 'request_id': 'req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:07.483121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] The token cache is being invalidate because project 69490227a80c49b69082303c03193b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:07.483455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:07.484542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3c8b164a-b3e4-4b62-bcc3-fc867c2b7b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:07.486225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 949/1919] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:07 2022] DELETE /identity/v3/projects/69490227a80c49b69082303c03193b5b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:07.491476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.491965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.492073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.543245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:07.544542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:07.606815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.617452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 971/1920] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:07.626123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.626418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.626706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.647201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:07.648480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:07.657525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 950/1921] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:07.661419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.672202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c39015-baf4-464d-b850-e4b2461a4466 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.677556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.678339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.678689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.678974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.679709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:07.680018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.681709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.696457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 972/1922] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.701048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.711813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16ea3-5dff-4fe3-94ff-146ca4127c60 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.716596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.717955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.718147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.719066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.719773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.721759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.827974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 951/1923] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:07 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:07.832366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.843115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249deeb6-b66e-479a-bcf8-b7f4c035cd53 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.904799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.906031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.906316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.906599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.907297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.909370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.997237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 973/1924] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:07 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:08.001846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.012717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ade3-a293-4b09-85f6-9c867d5a3869 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.019327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.020015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.020310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.020579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.021644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.023566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.035457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 952/1925] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:08.041062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.059247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670c99-ca47-4530-8612-9d7a73408c30 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.069153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.070429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.070878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.071951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.074494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec72cd-0f3d-4f4e-9275-c641b2a95a39 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.090991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 974/1926] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:08.092187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.105910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a560-591e-4dd5-87dc-2260cb572392 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.118969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.121298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.121298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.121298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] PATH_INFO: `/v3/projects/c978d4006ff444aa8e3d07ce77cf54fa/users/f42a01251fd44567854b7aeb34784cf4/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.150806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c978d4006ff444aa8e3d07ce77cf54fa, user_id=f42a01251fd44567854b7aeb34784cf4, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.156141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.253414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 953/1927] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:08 2022] PUT /identity/v3/projects/c978d4006ff444aa8e3d07ce77cf54fa/users/f42a01251fd44567854b7aeb34784cf4/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:08.266073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.270322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.270322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.297495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] MFA Rules not processed for user `f42a01251fd44567854b7aeb34784cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:08.298695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:08.372693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 975/1928] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:08.377906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.451911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecb3e-d911-4564-88d3-7fbb7ec0ced1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.457449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.458124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.458409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.458691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.459400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.461359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.570007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 954/1929] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:08 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:08.575261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.587983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d08719-2e78-498d-9ffa-e77dea0ff431 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.642804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.652348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.653078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.653361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.656326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.656326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.657242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.758574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 976/1930] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:08 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:08.759854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.772887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518359e1-2cfb-475b-8dd9-918edf4e6a3b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.778013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.778777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.779212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.779562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.781304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.782933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.794813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 955/1931] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:08.799952 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.811686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f00e-c5a5-4ac8-b78d-9da789016ba9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.817569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.818522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.818812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.819138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] PATH_INFO: `/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1/users/f15925447fbf4f87985cb8fc8c0dced3/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.840276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e02cf3c6174baa9c7b02785ca5baf1, user_id=f15925447fbf4f87985cb8fc8c0dced3, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.843627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.932028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 977/1932] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:08 2022] PUT /identity/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1/users/f15925447fbf4f87985cb8fc8c0dced3/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:08.936894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.947369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f581-766d-4be7-8214-641d1c61d14d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.952500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:09.017199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.017886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.018174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.018455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.019193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:09.020846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93bdbb-0a4c-49b9-bcec-8f560a43f523 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:09.032393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 956/1933] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:09.036833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.052698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fde9a3-ca0b-4c47-aa16-ff936988ddc7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.058678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.059597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.059891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.060366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] PATH_INFO: `/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1/users/f15925447fbf4f87985cb8fc8c0dced3/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.063092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e02cf3c6174baa9c7b02785ca5baf1, user_id=f15925447fbf4f87985cb8fc8c0dced3, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:09.065870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:09.078786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 978/1934] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:09 2022] PUT /identity/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1/users/f15925447fbf4f87985cb8fc8c0dced3/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:09.090787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.090787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.090787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.123599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] MFA Rules not processed for user `f15925447fbf4f87985cb8fc8c0dced3`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:09.125825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:09.231561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 957/1935] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:09.249887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.253884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:09.334263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd1b9-f0a3-43ad-a97a-5cbdab5991cd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.338002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.338664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.338962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.339221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.416624 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:09.418183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb082a-7551-4607-8ed5-74c17a669447 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:09.429432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 979/1936] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:14.876934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.943502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a5b8-287f-479a-a113-2e3322c850b0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.947981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.948893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.949176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.949451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] PATH_INFO: `/v3/users/f42a01251fd44567854b7aeb34784cf4` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.950646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42a01251fd44567854b7aeb34784cf4)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.953431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.184720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:15.203232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42a01251fd44567854b7aeb34784cf4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:15.221284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42a01251fd44567854b7aeb34784cf4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:15.222255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42a01251fd44567854b7aeb34784cf4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:15.223247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42a01251fd44567854b7aeb34784cf4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:15.339373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42a01251fd44567854b7aeb34784cf4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:15.354144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 958/1937] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:14 2022] DELETE /identity/v3/users/f42a01251fd44567854b7aeb34784cf4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:15.371139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.371683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.371683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.391942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:15.393265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:15.460146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:15.470386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 980/1938] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:15.480601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:15.482182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:15.540902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1807-31e5-4ff5-ad1d-968e00a516b6 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:15.545140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:15.546415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.546785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.547067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.556884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:15.558366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.569218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 959/1939] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:16.091455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:16.093599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:16.109910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a92b-46cb-4507-a683-866848869f5c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:16.115126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:16.121382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:16.121466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:16.121751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] PATH_INFO: `/v3/projects/c978d4006ff444aa8e3d07ce77cf54fa` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:16.123090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c978d4006ff444aa8e3d07ce77cf54fa)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:16.125649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:16.321280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c978d4006ff444aa8e3d07ce77cf54fa', 'request_id': 'req-396517ec-eefa-46fb-a782-68d1392ea555'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.430755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c978d4006ff444aa8e3d07ce77cf54fa', 'request_id': 'req-396517ec-eefa-46fb-a782-68d1392ea555'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.439529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c978d4006ff444aa8e3d07ce77cf54fa', 'request_id': 'req-396517ec-eefa-46fb-a782-68d1392ea555'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.451924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] The token cache is being invalidate because project c978d4006ff444aa8e3d07ce77cf54fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:16.452539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.453280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.457226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 981/1940] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:16 2022] DELETE /identity/v3/projects/c978d4006ff444aa8e3d07ce77cf54fa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:16.466020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:16.481678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e4d-e88c-4596-98aa-ff42ad5cce29 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:16.545008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:16.546448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:16.546733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:16.547013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] PATH_INFO: `/v3/users/f15925447fbf4f87985cb8fc8c0dced3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:16.548439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15925447fbf4f87985cb8fc8c0dced3)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:16.550512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:16.774831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15925447fbf4f87985cb8fc8c0dced3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.780231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:16.786983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15925447fbf4f87985cb8fc8c0dced3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.787684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15925447fbf4f87985cb8fc8c0dced3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.788357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15925447fbf4f87985cb8fc8c0dced3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.857062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f845aa7-1044-48e6-86c9-6b7c0356e235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15925447fbf4f87985cb8fc8c0dced3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:16.871490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 960/1941] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:16 2022] DELETE /identity/v3/users/f15925447fbf4f87985cb8fc8c0dced3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:17.400506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.407436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:17.418445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396517ec-eefa-46fb-a782-68d1392ea555 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.502166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.503155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.503507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.503856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] PATH_INFO: `/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.505152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e02cf3c6174baa9c7b02785ca5baf1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.507233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.638139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e02cf3c6174baa9c7b02785ca5baf1', 'request_id': 'req-ce24c9d6-7714-4d47-950a-71d842b6d248'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:17.704757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e02cf3c6174baa9c7b02785ca5baf1', 'request_id': 'req-ce24c9d6-7714-4d47-950a-71d842b6d248'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:17.712696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e02cf3c6174baa9c7b02785ca5baf1', 'request_id': 'req-ce24c9d6-7714-4d47-950a-71d842b6d248'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:17.728961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] The token cache is being invalidate because project 65e02cf3c6174baa9c7b02785ca5baf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:17.729469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:17.730614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ce24c9d6-7714-4d47-950a-71d842b6d248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:17.734190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 982/1942] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:17 2022] DELETE /identity/v3/projects/65e02cf3c6174baa9c7b02785ca5baf1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:17.739854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.740355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.740546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.761876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:17.763454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:17.833975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 961/1943] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:17.839563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.839874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.840157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.859994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:17.861290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:17.869577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 983/1944] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:17.874196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.884226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033cbe5-7b64-4362-af58-ad9fcd486e8c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.889019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.890625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.890910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.891191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.891921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:17.892231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.893869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.907023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 962/1945] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:17.911522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.921590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9a85b-5475-4e9e-ab4b-f8ecaaa8d111 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.926182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.926837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.927121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.927397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.928083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.930007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.933343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.061575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 984/1946] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:18.068125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.079762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a49d34-26d4-4a0e-9480-dffff8a39d4d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.138456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.139226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.139647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.140018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.140992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.142949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.241386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 963/1947] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:18.245733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.257254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6faa2f-bcf6-48a0-8648-bbdc372e4082 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.262500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.263184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.272350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.272350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.272350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.272350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.280421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 985/1948] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:18.285763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.305518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491780-e658-4ac5-834f-523092da73bc admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.310812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.311636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.312058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.312647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.313302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.314929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690876b5-6af9-428c-9536-506947caa018 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.326846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 964/1949] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:18.331371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.342003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1076c-e62a-40c8-a289-7c4bdc213ca8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.347252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.348155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.348446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.348764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] PATH_INFO: `/v3/projects/afe0c424abc942b2b3e9ee2f293a602f/users/72339a2696c64f4c8ccb56151ef0f7bf/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.365127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe0c424abc942b2b3e9ee2f293a602f, user_id=72339a2696c64f4c8ccb56151ef0f7bf, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.367839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.497495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 986/1950] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:18 2022] PUT /identity/v3/projects/afe0c424abc942b2b3e9ee2f293a602f/users/72339a2696c64f4c8ccb56151ef0f7bf/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:18.510926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.511270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.511513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.542505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] MFA Rules not processed for user `72339a2696c64f4c8ccb56151ef0f7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:18.543733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:18.570989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.612637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 965/1951] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:18.617313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.682980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec876-27da-4e5c-a795-dd405c6ad6b1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.691676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.692367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.692690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.692976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.693709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.695656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.802584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 987/1952] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:18.803692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.815603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e527cd-d96a-4d6e-83a6-ad01f46d42fc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.883155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.884341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.884884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.885406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.886690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.890916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.020688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 966/1953] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:19.023430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.035632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df352c-d471-4f4c-a4ce-215ed9433c92 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.040284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.040990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.041280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.041566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.042294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.043897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.058758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 988/1954] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:19.060651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.071586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04d1f3-2a92-4840-9d09-80fb022aebf9 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.082671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.083271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.083562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.083846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.084593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.086229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15757-5c7e-4db6-802a-322a0a325576 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.103197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 967/1955] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:19.107680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.120334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6624a7-a73f-4932-a925-2dfdba0e99f8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.127994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.128925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.129221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.129507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] PATH_INFO: `/v3/projects/7d1b2222c4bf41768b648be15a84b201/users/9e5304cb7e4347acaeddb7887abf62a8/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.145735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1b2222c4bf41768b648be15a84b201, user_id=9e5304cb7e4347acaeddb7887abf62a8, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.148453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.240291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 989/1956] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:19 2022] PUT /identity/v3/projects/7d1b2222c4bf41768b648be15a84b201/users/9e5304cb7e4347acaeddb7887abf62a8/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:19.250729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.250950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.251232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.279325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] MFA Rules not processed for user `9e5304cb7e4347acaeddb7887abf62a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:19.281276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:19.355421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 968/1957] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:19.359941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.423925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a031-2602-4ddc-8d19-dd4592bcc0eb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.428910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.429615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.429901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.430306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.431023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.433033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.437011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.590668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 990/1958] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:19 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:19.596043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.607546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91238a2e-6f98-4dbe-89e0-db560a52050c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.649741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.680666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.681361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.681644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.681920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.682651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.684604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.781766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 969/1959] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:19 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:19.786025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.797354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf7bb-6f22-40f1-83e8-666b4dfb4b8b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.801986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.802657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.802949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.803218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.803947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.805570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.816976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 991/1960] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:19.821512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.832976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0358c6-5bf7-46c3-978d-6852e7b0e754 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.839038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.839038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.839257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.840257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] PATH_INFO: `/v3/projects/21684921f99943819e413c224100cd81/users/ad583ee5d1a7466589d75da735afcfea/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.873233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21684921f99943819e413c224100cd81, user_id=ad583ee5d1a7466589d75da735afcfea, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.878654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.979443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 970/1961] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:19 2022] PUT /identity/v3/projects/21684921f99943819e413c224100cd81/users/ad583ee5d1a7466589d75da735afcfea/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:19.985704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.999503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d342bf-d9f1-4e21-b01e-572039cb50c5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:20.093676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:20.094874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.095406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.095745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.096718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.098621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117cbef-9f8e-48d2-9469-955f79324731 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.110566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 992/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:20.116752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:20.129097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae022-b83f-4c28-9e27-cf9028eca8f4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:20.134636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:20.135680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.136040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.137158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] PATH_INFO: `/v3/projects/21684921f99943819e413c224100cd81/users/ad583ee5d1a7466589d75da735afcfea/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.142200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21684921f99943819e413c224100cd81, user_id=ad583ee5d1a7466589d75da735afcfea, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.146890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.166990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 971/1963] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:20 2022] PUT /identity/v3/projects/21684921f99943819e413c224100cd81/users/ad583ee5d1a7466589d75da735afcfea/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:20.182336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.182662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.182950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.214704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] MFA Rules not processed for user `ad583ee5d1a7466589d75da735afcfea`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:20.216285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:20.301629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 993/1964] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:20.321835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:20.321835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:20.390657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df152-ee95-4b76-84aa-593e6e4bc976 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:20.394477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:20.395225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.395665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.395802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.484890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.486359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.496248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 972/1965] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:23.905976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.907420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:23.965240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.976218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e60f1-ffcf-4f64-9f3e-3cb5d3764242 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.985402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.986202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.986570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.986925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.021367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:24.028072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed686a5-6f15-4220-88b6-f43c3ad69c60 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:24.033497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:24.034403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.034682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.035015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] PATH_INFO: `/v3/users/c62b690fcb0e4847904d13943924327b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.036357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62b690fcb0e4847904d13943924327b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:24.038337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:24.041219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:24.064045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:24.065492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f209e-a039-4201-8c01-2d033f9c3367 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:24.074917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 973/1966] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:24.295995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62b690fcb0e4847904d13943924327b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:24.297725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62b690fcb0e4847904d13943924327b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:24.324225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62b690fcb0e4847904d13943924327b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:24.325010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62b690fcb0e4847904d13943924327b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:24.422919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62b690fcb0e4847904d13943924327b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:24.448821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 994/1967] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:23 2022] DELETE /identity/v3/users/c62b690fcb0e4847904d13943924327b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:24.455311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.455690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.455923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.477011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:24.478367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:24.562238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 974/1968] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:24.572162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.576257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:24.676205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1e6d-5e07-4f9b-9b7c-5a5034aa00a0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:24.680260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:24.681094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.681387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.681670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.691977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:24.693457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:24.705977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 995/1969] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:25.369954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.371266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:25.396280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0e5-ad54-43c4-a7c6-1b7584e9883a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.405833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.408507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.408507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.408507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] PATH_INFO: `/v3/projects/847c92b12aa94e54868fae8afbab40c0` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.408507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847c92b12aa94e54868fae8afbab40c0)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.410637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.562053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847c92b12aa94e54868fae8afbab40c0', 'request_id': 'req-5edafc5e-a84f-489e-893c-9e6cb87b8921'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:25.569366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847c92b12aa94e54868fae8afbab40c0', 'request_id': 'req-5edafc5e-a84f-489e-893c-9e6cb87b8921'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:25.575373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847c92b12aa94e54868fae8afbab40c0', 'request_id': 'req-5edafc5e-a84f-489e-893c-9e6cb87b8921'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:25.680228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] The token cache is being invalidate because project 847c92b12aa94e54868fae8afbab40c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:25.681162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:25.683656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:25.684455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 975/1970] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:25 2022] DELETE /identity/v3/projects/847c92b12aa94e54868fae8afbab40c0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:25.688592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.701207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09d0d-0a3b-445d-adbf-4346c233c46a service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.791241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.793454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.793913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.794387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] PATH_INFO: `/v3/users/e183475108494da09c09b47b54277553` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.796347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e183475108494da09c09b47b54277553)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.798993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.838987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.084576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e183475108494da09c09b47b54277553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:26.085693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e183475108494da09c09b47b54277553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:26.100502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e183475108494da09c09b47b54277553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:26.103962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e183475108494da09c09b47b54277553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:26.230793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e183475108494da09c09b47b54277553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:26.255591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.257062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:26.260646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 996/1971] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:25 2022] DELETE /identity/v3/users/e183475108494da09c09b47b54277553 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:26.347240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edafc5e-a84f-489e-893c-9e6cb87b8921 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.364997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.399683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.400438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.400657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.401030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.402783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:26.478205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.479802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.502624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 976/1972] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:26.897706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.899701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.009079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930bb56-85a0-437b-bd91-335de942197f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.019170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.021559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.022067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.022946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] PATH_INFO: `/v3/projects/2c15a09ab92940c89442626fbca4eddd` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.026644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c15a09ab92940c89442626fbca4eddd)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.033417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.157566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.159029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.173219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58224-a09c-4f4d-bbc2-b08d67c5b94b service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.184296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c15a09ab92940c89442626fbca4eddd', 'request_id': 'req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.264623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.266433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.266931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.267441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] PATH_INFO: `/v3/users/f83461c482e0439198c010139f283d18` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.269591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83461c482e0439198c010139f283d18)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.273434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.294833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c15a09ab92940c89442626fbca4eddd', 'request_id': 'req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.313202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c15a09ab92940c89442626fbca4eddd', 'request_id': 'req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.328257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] The token cache is being invalidate because project 2c15a09ab92940c89442626fbca4eddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:27.328257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.328949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-84952cb2-7c3c-4ba8-a885-f34b3557ae4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.330604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 997/1973] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:26 2022] DELETE /identity/v3/projects/2c15a09ab92940c89442626fbca4eddd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:27.336472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57886-00b8-4fea-a0b8-fa4081be2ff1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.336900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57886-00b8-4fea-a0b8-fa4081be2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.337099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57886-00b8-4fea-a0b8-fa4081be2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.369231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5eb57886-00b8-4fea-a0b8-fa4081be2ff1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:27.370489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5eb57886-00b8-4fea-a0b8-fa4081be2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.380326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 998/1974] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:27.388655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.389586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.390829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.411012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:27.413268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.426892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 999/1975] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:27.428028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.434451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:27.438751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65c62b-2ddc-46f7-a68f-41fed36cfcfd None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.443592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.444303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.444589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.444897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.446093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:27.446093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.447852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.464633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1000/1976] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:27.465571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.476700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dc283-6b36-435b-ad5b-53da66f04db1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.482174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.483435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.483940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.484133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.484965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.486869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.620984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1001/1977] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:27.626417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83461c482e0439198c010139f283d18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.631408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.669225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83461c482e0439198c010139f283d18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.677336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83461c482e0439198c010139f283d18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.677336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83461c482e0439198c010139f283d18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.720227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979f46-8fb5-4d1f-88ae-9a5d7aa53bc9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.727874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.728635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.728925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.729285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.730006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.731977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.778211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a2c25ab8-1e1c-4cdb-afc7-d6f369d6d2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83461c482e0439198c010139f283d18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:27.781636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:27.799543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 977/1978] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:27 2022] DELETE /identity/v3/users/f83461c482e0439198c010139f283d18 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:27.805283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.805576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.805911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.825057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:27.826958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.830297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1002/1979] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:27.835519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.839429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.860640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf605-1d1b-4310-8adb-922b3c51b189 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.906396 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 978/1980] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:27.917989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.919435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.928045 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.928763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.929051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.929327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.930194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.931822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.946228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1003/1981] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:00:27.947274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.957900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f0fe-2f60-4414-8581-2d7d26aed641 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.962653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.963328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.963609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.963885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.964689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.966290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.978428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1004/1982] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:27.983577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.984524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d69c5-a019-4787-b9bc-3bcb94c77f5d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.989071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.990115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.994992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.994992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.995221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593e04b-2e31-4526-abe2-0268d8e67771 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.000241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.001190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.001477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.001779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] PATH_INFO: `/v3/projects/6a25f19f914942f29058c89ddefa0e71/users/40e9386d752b49ae9d661ff247b0864a/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.002958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.004563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431557e8-72ff-4f70-b562-3bef0ad73279 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.015958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 979/1983] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:28.021263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a25f19f914942f29058c89ddefa0e71, user_id=40e9386d752b49ae9d661ff247b0864a, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.023942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.143409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1005/1984] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:27 2022] PUT /identity/v3/projects/6a25f19f914942f29058c89ddefa0e71/users/40e9386d752b49ae9d661ff247b0864a/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:28.157643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.158420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.161131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.211282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] MFA Rules not processed for user `40e9386d752b49ae9d661ff247b0864a`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:28.213497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:28.365818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 980/1985] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:28.422334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.426171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:28.460522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.502278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623cf46-3af1-4193-9ba3-9156ac547654 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.509386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.509386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.509386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.509386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.518733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.520390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.531632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1006/1986] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:28.601925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.601925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:28.675466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.748924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a24c4-8d1f-4ef1-bcbf-934012296c6b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.769247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.770305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.770976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.771439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] PATH_INFO: `/v3/projects/df7705c3a21047f18be4dac62e7cddb0` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.772807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7705c3a21047f18be4dac62e7cddb0)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.774750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.918296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7705c3a21047f18be4dac62e7cddb0', 'request_id': 'req-bca75713-b546-4338-8157-b328f9357734'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:28.927951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7705c3a21047f18be4dac62e7cddb0', 'request_id': 'req-bca75713-b546-4338-8157-b328f9357734'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:28.934882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7705c3a21047f18be4dac62e7cddb0', 'request_id': 'req-bca75713-b546-4338-8157-b328f9357734'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.083457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] The token cache is being invalidate because project df7705c3a21047f18be4dac62e7cddb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:29.083751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.084518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.086569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 981/1987] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:28 2022] DELETE /identity/v3/projects/df7705c3a21047f18be4dac62e7cddb0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:29.090531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:29.111134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a074-a119-435a-a964-74bc23044b5d service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:29.195052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:29.196216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:29.196505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:29.199705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] PATH_INFO: `/v3/users/b1642b68d76d4e85a13b5a26383b1f5a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:29.199705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1642b68d76d4e85a13b5a26383b1f5a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:29.200435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:29.512269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1642b68d76d4e85a13b5a26383b1f5a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.513555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1642b68d76d4e85a13b5a26383b1f5a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.523432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1642b68d76d4e85a13b5a26383b1f5a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.524151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1642b68d76d4e85a13b5a26383b1f5a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.611515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c2c1ed0-d43a-4676-bb26-dc867742fc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1642b68d76d4e85a13b5a26383b1f5a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:29.662936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1007/1988] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:29 2022] DELETE /identity/v3/users/b1642b68d76d4e85a13b5a26383b1f5a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:30.219463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:30.223010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.251515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75713-b546-4338-8157-b328f9357734 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:30.358894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:30.360048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.360550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.361089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] PATH_INFO: `/v3/projects/99654ff770b84212b28f4f2c66373954` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.363387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99654ff770b84212b28f4f2c66373954)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:30.367179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:30.533561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99654ff770b84212b28f4f2c66373954', 'request_id': 'req-c88f7e90-411e-49bb-a463-c9169ab800a9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:30.540730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99654ff770b84212b28f4f2c66373954', 'request_id': 'req-c88f7e90-411e-49bb-a463-c9169ab800a9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:30.542236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:30.547627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99654ff770b84212b28f4f2c66373954', 'request_id': 'req-c88f7e90-411e-49bb-a463-c9169ab800a9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:30.616888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] The token cache is being invalidate because project 99654ff770b84212b28f4f2c66373954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:30.617181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:30.617864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c88f7e90-411e-49bb-a463-c9169ab800a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:30.619445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 982/1989] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:30 2022] DELETE /identity/v3/projects/99654ff770b84212b28f4f2c66373954 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:30.624663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.625242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.625352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.646367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:30.647721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.694979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:30.722430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1008/1990] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:30.730423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.730655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.730948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.755844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:30.757211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.766927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 983/1991] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:30.777923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:30.799170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12391a66-99f9-4752-bc5f-7b186f639b64 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:30.799170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:30.799170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.799170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.800446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.800446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:30.800446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:30.800685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:30.817573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1009/1992] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:30.823868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:30.845212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b2c1d-6b79-4e11-aeb7-da9a1bd3d3ac None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:30.855838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:30.859795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.859795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.859795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.859795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:30.861374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:30.998119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 984/1993] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:30.999595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.010031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662423d-213b-4ceb-adac-6e097d4aabeb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.083204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.084206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.084689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.085112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.085985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.089687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.235588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1010/1994] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:31.240664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.252960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a261e9-33bb-41f4-a31e-0830fd3e8f2e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.259012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.260078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.260495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.260935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.261917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.264464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.278699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 985/1995] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:00:31.285191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.300178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c224f-ac99-46f2-b041-cf943a976646 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.306586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.307029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.307448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.307899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.309914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.311809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d019f-3f99-410e-808e-0de30f0d96fc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.332878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1011/1996] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:31.336684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.349053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c5c9-d626-4489-88a2-fb3a16a368b8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.355889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.356908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.357208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.358047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] PATH_INFO: `/v3/projects/643e7f074917491699fd7cc284994c52/users/85050332bb564082bd67b88ccd0d627e/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.415291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643e7f074917491699fd7cc284994c52, user_id=85050332bb564082bd67b88ccd0d627e, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.415291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.570335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 986/1997] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:31 2022] PUT /identity/v3/projects/643e7f074917491699fd7cc284994c52/users/85050332bb564082bd67b88ccd0d627e/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:31.582667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.582960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.583253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.614487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] MFA Rules not processed for user `85050332bb564082bd67b88ccd0d627e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:31.615635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:31.733218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1012/1998] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:31.735496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.818820 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33f6a-deb9-4d14-9431-32e364925804 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.823735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.825745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.825745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.825745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.825998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.828078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.940005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 987/1999] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:31 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:31.944176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.958323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622920c-4352-4ad9-8d48-9c04f56937a2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.021225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.069860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.071517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.071959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.072392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.073598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.075805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.187407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1013/2000] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:31 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:32.188945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.199926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef594c-3c62-4ca3-8a82-2c01f0e90653 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.206245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.206971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.207255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.207541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.208303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.211190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.230749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 988/2001] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:32.235258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.246753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99a611-5584-4291-bb6d-b742c6db700f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.268309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.269343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.269634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.269916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] PATH_INFO: `/v3/projects/33a92ae725dd429c9d6c8d609960fc03/users/a3419689d72c4248a3a72b448aa461b2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.297900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a92ae725dd429c9d6c8d609960fc03, user_id=a3419689d72c4248a3a72b448aa461b2, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.301551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.405099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1014/2002] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:32 2022] PUT /identity/v3/projects/33a92ae725dd429c9d6c8d609960fc03/users/a3419689d72c4248a3a72b448aa461b2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:32.409602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.426550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb0ef7-e073-4d93-96c4-21c9e96d1483 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.530483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.551244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.551244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.551244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.551244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.551781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.551781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51579d-9bf4-4384-8d3b-98585dd46276 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.566726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 989/2003] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:32.570813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.585737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268178-63b4-4034-b79c-6a080d14de0e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.592848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.594140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.594438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.594775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] PATH_INFO: `/v3/projects/33a92ae725dd429c9d6c8d609960fc03/users/a3419689d72c4248a3a72b448aa461b2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.598715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a92ae725dd429c9d6c8d609960fc03, user_id=a3419689d72c4248a3a72b448aa461b2, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.600402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.616161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1015/2004] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:32 2022] PUT /identity/v3/projects/33a92ae725dd429c9d6c8d609960fc03/users/a3419689d72c4248a3a72b448aa461b2/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:32.627385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.627728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.628014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.660426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] MFA Rules not processed for user `a3419689d72c4248a3a72b448aa461b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:32.661699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:32.748998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 990/2005] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:32.757011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.758917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:32.843238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbea751-ce84-46a8-991a-1e6beda1e32c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.848868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.849826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.850267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.850696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.871432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.874524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.895198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1016/2006] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:33.097142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.274773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ad16d-2c5b-49e2-ba92-da72a346aa95 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.286093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.287697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.288414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.288739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] PATH_INFO: `/v3/users/85050332bb564082bd67b88ccd0d627e` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.290893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85050332bb564082bd67b88ccd0d627e)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.294423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.628767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85050332bb564082bd67b88ccd0d627e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:33.650757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85050332bb564082bd67b88ccd0d627e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:33.650757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85050332bb564082bd67b88ccd0d627e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:33.650757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85050332bb564082bd67b88ccd0d627e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:33.738601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.739928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c5440bb7-38a3-4196-8ebc-351195e6c6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85050332bb564082bd67b88ccd0d627e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:33.742996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:33.751455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.778252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 991/2007] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:33 2022] DELETE /identity/v3/users/85050332bb564082bd67b88ccd0d627e => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:33.783921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.784463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.784791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.787251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d14c98-9ae7-439f-8eb1-5a0ffd458cdc service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.810007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:33.812388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:33.924441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 992/2008] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:33.930137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.931185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.931483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.931922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] PATH_INFO: `/v3/users/72339a2696c64f4c8ccb56151ef0f7bf` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.933422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72339a2696c64f4c8ccb56151ef0f7bf)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.935592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.943292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.948851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.071478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5be9-3566-4961-831c-a87be09edf99 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.078880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.079498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.079752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.080035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.090500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.092592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.102983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 993/2009] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:34.103945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.115119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.132901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285da55c-f129-4e03-860a-3633ae418215 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.140485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.142305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.142671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.143264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] PATH_INFO: `/v3/users/771a2d92bf0a4a4890677b9972b9ff91` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.145409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771a2d92bf0a4a4890677b9972b9ff91)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.147601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.196631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.211711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72339a2696c64f4c8ccb56151ef0f7bf'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.212457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72339a2696c64f4c8ccb56151ef0f7bf'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.233754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72339a2696c64f4c8ccb56151ef0f7bf'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.234743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72339a2696c64f4c8ccb56151ef0f7bf'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.304982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-625764c5-9a5b-42b3-892f-ef4aaa02daa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72339a2696c64f4c8ccb56151ef0f7bf'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.335623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1017/2010] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:33 2022] DELETE /identity/v3/users/72339a2696c64f4c8ccb56151ef0f7bf => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:34.343544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.344000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.344472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.365170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771a2d92bf0a4a4890677b9972b9ff91'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.381435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:34.382683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.386060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771a2d92bf0a4a4890677b9972b9ff91'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.387147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771a2d92bf0a4a4890677b9972b9ff91'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.388171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771a2d92bf0a4a4890677b9972b9ff91'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.475923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1018/2011] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:34.497896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.500373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.511110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7394989d-dc5c-4102-b2e0-18eded5a8886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771a2d92bf0a4a4890677b9972b9ff91'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:34.541054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 994/2012] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:34 2022] DELETE /identity/v3/users/771a2d92bf0a4a4890677b9972b9ff91 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:34.547491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.547791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.548162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.571571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:34.573340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.579975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.596308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464fc1-788e-4f26-a966-30c7a35eef60 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.661721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 995/2013] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:34.675131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.676500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.677232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.677519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.677795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.690254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.691760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.696181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be628bcb-8505-4dd4-ad0b-e4d917a449d4 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.702887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.704956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.705411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.706140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.706980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1019/2014] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:34.725815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.744803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.744803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 996/2015] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:34.803170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.805091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:34.823233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507235a-a0e9-4715-8b44-9fe0a324fd12 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.828763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.829765 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.830114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.830449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] PATH_INFO: `/v3/projects/643e7f074917491699fd7cc284994c52` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.831810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643e7f074917491699fd7cc284994c52)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.834089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.848060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.997686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643e7f074917491699fd7cc284994c52', 'request_id': 'req-483eacfd-1bdd-446d-814f-f1c7e822e931'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.109571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643e7f074917491699fd7cc284994c52', 'request_id': 'req-483eacfd-1bdd-446d-814f-f1c7e822e931'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.127454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643e7f074917491699fd7cc284994c52', 'request_id': 'req-483eacfd-1bdd-446d-814f-f1c7e822e931'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.182164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] The token cache is being invalidate because project 643e7f074917491699fd7cc284994c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:35.183063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.189519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.192236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1020/2016] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:34 2022] DELETE /identity/v3/projects/643e7f074917491699fd7cc284994c52 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:35.198359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.214781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e7e4-b016-4b61-9cf1-c4025fcbf378 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:35.337773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:35.338305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:35.338593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:35.338874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] PATH_INFO: `/v3/users/a3419689d72c4248a3a72b448aa461b2` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:35.346606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3419689d72c4248a3a72b448aa461b2)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:35.347705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:35.576808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.578405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:35.603857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eacfd-1bdd-446d-814f-f1c7e822e931 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:35.612576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:35.613511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:35.613848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:35.614138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] PATH_INFO: `/v3/projects/afe0c424abc942b2b3e9ee2f293a602f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:35.616706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe0c424abc942b2b3e9ee2f293a602f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:35.619026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:35.649310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3419689d72c4248a3a72b448aa461b2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.689112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3419689d72c4248a3a72b448aa461b2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.690327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3419689d72c4248a3a72b448aa461b2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.691327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3419689d72c4248a3a72b448aa461b2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.821874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe0c424abc942b2b3e9ee2f293a602f', 'request_id': 'req-93545cc2-8ffd-45af-a04e-16798ce4bd32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.836083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3419689d72c4248a3a72b448aa461b2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.862310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 997/2017] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:35 2022] DELETE /identity/v3/users/a3419689d72c4248a3a72b448aa461b2 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:35.863532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.865271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:35.891610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:35.942693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe0c424abc942b2b3e9ee2f293a602f', 'request_id': 'req-93545cc2-8ffd-45af-a04e-16798ce4bd32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.953316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe0c424abc942b2b3e9ee2f293a602f', 'request_id': 'req-93545cc2-8ffd-45af-a04e-16798ce4bd32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.974024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] The token cache is being invalidate because project afe0c424abc942b2b3e9ee2f293a602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:35.974480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.975287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:35.980242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1021/2018] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:35 2022] DELETE /identity/v3/projects/afe0c424abc942b2b3e9ee2f293a602f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:35.984755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.986366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:36.004064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122099e-cd8f-45c2-a33c-697248524854 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.019153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.021132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.025301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.025775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] PATH_INFO: `/v3/projects/882fe602ca5149dbba9af29c93c34272` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.027373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882fe602ca5149dbba9af29c93c34272)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:36.030348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:36.121632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545cc2-8ffd-45af-a04e-16798ce4bd32 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.127695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.128743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.129127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.129863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] PATH_INFO: `/v3/users/9e5304cb7e4347acaeddb7887abf62a8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.131679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5304cb7e4347acaeddb7887abf62a8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:36.133610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:36.193738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882fe602ca5149dbba9af29c93c34272', 'request_id': 'req-cd23d70f-d55b-4185-a9d6-af38dce51942'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.201720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882fe602ca5149dbba9af29c93c34272', 'request_id': 'req-cd23d70f-d55b-4185-a9d6-af38dce51942'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.211194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882fe602ca5149dbba9af29c93c34272', 'request_id': 'req-cd23d70f-d55b-4185-a9d6-af38dce51942'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.321119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] The token cache is being invalidate because project 882fe602ca5149dbba9af29c93c34272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:36.321414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.322158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.323918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 998/2019] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:35 2022] DELETE /identity/v3/projects/882fe602ca5149dbba9af29c93c34272 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:36.330193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.331696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:36.385947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5304cb7e4347acaeddb7887abf62a8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.386647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5304cb7e4347acaeddb7887abf62a8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.397939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5304cb7e4347acaeddb7887abf62a8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.398638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5304cb7e4347acaeddb7887abf62a8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.401879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d70f-d55b-4185-a9d6-af38dce51942 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.406423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.411765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.411765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.411765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.411765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] PATH_INFO: `/v3/users/f32d60215da9474a949e11a1f02a6eba` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.412573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32d60215da9474a949e11a1f02a6eba)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:36.413533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:36.485711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5304cb7e4347acaeddb7887abf62a8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.508001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1022/2020] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:35 2022] DELETE /identity/v3/users/9e5304cb7e4347acaeddb7887abf62a8 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:36.509285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.510865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:36.589615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f4b3-c5b6-4d95-82f6-dc3f9fa281fc admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.595424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.596446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.596928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.597912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] PATH_INFO: `/v3/projects/33a92ae725dd429c9d6c8d609960fc03` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.598756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a92ae725dd429c9d6c8d609960fc03)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:36.602822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:36.624386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32d60215da9474a949e11a1f02a6eba'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.644250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32d60215da9474a949e11a1f02a6eba'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.645805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32d60215da9474a949e11a1f02a6eba'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.646806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32d60215da9474a949e11a1f02a6eba'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.778174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a92ae725dd429c9d6c8d609960fc03', 'request_id': 'req-f23e9179-82ba-4cb3-a8b8-776f89cb6531'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.829151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-582820fc-ce15-41d4-9590-496ced46a06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32d60215da9474a949e11a1f02a6eba'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.843886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 999/2021] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:36 2022] DELETE /identity/v3/users/f32d60215da9474a949e11a1f02a6eba => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:36.948775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a92ae725dd429c9d6c8d609960fc03', 'request_id': 'req-f23e9179-82ba-4cb3-a8b8-776f89cb6531'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.959071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a92ae725dd429c9d6c8d609960fc03', 'request_id': 'req-f23e9179-82ba-4cb3-a8b8-776f89cb6531'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.977026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] The token cache is being invalidate because project 33a92ae725dd429c9d6c8d609960fc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:36.977323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.978023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f23e9179-82ba-4cb3-a8b8-776f89cb6531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:36.981958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1023/2022] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:36 2022] DELETE /identity/v3/projects/33a92ae725dd429c9d6c8d609960fc03 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:36.994473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.994473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.994473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.011113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:37.012410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.091298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1000/2023] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:37.107530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.107530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.107530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.128755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.145072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:37.151657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.170689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1024/2024] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:37.175168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.189081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e12ca-f4ef-47cd-9849-a6a4d4a5d970 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.196931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.197868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.198270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.198687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.199563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:37.200025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.206427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.224850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.230139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1001/2025] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.241131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb2bd-fb8e-41a8-b4a1-ef15d443c99a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.247763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.248562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.249686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.249686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.250361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.254263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.374029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.376425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.398661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee16d-8b34-4ad7-8073-3f98938492b8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.409239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.410758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.411426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.411716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] PATH_INFO: `/v3/projects/7d1b2222c4bf41768b648be15a84b201` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.413437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1b2222c4bf41768b648be15a84b201)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.415417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.422601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1025/2026] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:37 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:37.427251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.521679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ee53-09f9-4ecc-863c-ee49c21e9905 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.527299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.528202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.528490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.528856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.530761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.533801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.585109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.586621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1b2222c4bf41768b648be15a84b201', 'request_id': 'req-51c6cbbf-e284-4a81-8a76-f85f7b498b10'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:37.600320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1b2222c4bf41768b648be15a84b201', 'request_id': 'req-51c6cbbf-e284-4a81-8a76-f85f7b498b10'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:37.608672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1b2222c4bf41768b648be15a84b201', 'request_id': 'req-51c6cbbf-e284-4a81-8a76-f85f7b498b10'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:37.667565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1026/2027] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:37 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:37.667565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.667565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.681806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70bb7b-4d5c-478f-bfe3-1204a237ce13 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.704737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] The token cache is being invalidate because project 7d1b2222c4bf41768b648be15a84b201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:37.705347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:37.706435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:37.708676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1002/2028] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:37 2022] DELETE /identity/v3/projects/7d1b2222c4bf41768b648be15a84b201 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:37.714138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.715853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.758472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.759725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.760064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.760350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] PATH_INFO: `/v3/projects/3a5abac4ae284058b12aea856b37abbe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.761793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5abac4ae284058b12aea856b37abbe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.765440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.803250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6cbbf-e284-4a81-8a76-f85f7b498b10 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.809148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.809840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.810136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.810568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.812209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.813889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.824931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1003/2029] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:37.826552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.829911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.843626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9c00-716e-4c2e-9f22-e6ef7d55b405 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.848677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.849581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.850024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.850195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] PATH_INFO: `/v3/users/ad583ee5d1a7466589d75da735afcfea` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.851487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad583ee5d1a7466589d75da735afcfea)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.855492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.896476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5abac4ae284058b12aea856b37abbe', 'request_id': 'req-f2ef1930-63b6-4e49-b770-75b9073ffca9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.005579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5abac4ae284058b12aea856b37abbe', 'request_id': 'req-f2ef1930-63b6-4e49-b770-75b9073ffca9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.012542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5abac4ae284058b12aea856b37abbe', 'request_id': 'req-f2ef1930-63b6-4e49-b770-75b9073ffca9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] The token cache is being invalidate because project 3a5abac4ae284058b12aea856b37abbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:38.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1027/2030] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:37 2022] DELETE /identity/v3/projects/3a5abac4ae284058b12aea856b37abbe => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:38.040446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.041014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.118432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad583ee5d1a7466589d75da735afcfea'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.119382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1930-63b6-4e49-b770-75b9073ffca9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.125206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.125894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.126183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.126464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.127206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.128837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81e0a-48e4-4b72-8bdb-386797bad1a7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.131221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad583ee5d1a7466589d75da735afcfea'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.131947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad583ee5d1a7466589d75da735afcfea'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.132550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad583ee5d1a7466589d75da735afcfea'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.141398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1028/2031] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:38.143169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.144232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.147925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.164891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.166209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.175275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1029/2032] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:38.176850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.178372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.191996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873485a-18a8-4fac-8e66-d9cee8756f84 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.197101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.198121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.198415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.198703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] PATH_INFO: `/v3/projects/6e9fcaaf4cf34da49216c546dcfa9432/users/e135d5a0a42d49149e21189b15fe2834/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.218510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9fcaaf4cf34da49216c546dcfa9432, user_id=e135d5a0a42d49149e21189b15fe2834, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.221043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e204f3-fcb0-4f55-8acf-afc50936f28d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.253128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ef7b05c3-410f-4e1a-b13d-d74ae5587c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad583ee5d1a7466589d75da735afcfea'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:38.274097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1004/2033] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:37 2022] DELETE /identity/v3/users/ad583ee5d1a7466589d75da735afcfea => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:38.274097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.274097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.274097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.316416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.317697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.339066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1030/2034] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:38 2022] PUT /identity/v3/projects/6e9fcaaf4cf34da49216c546dcfa9432/users/e135d5a0a42d49149e21189b15fe2834/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:38.351376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.352043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.352542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.381965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.384558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.405360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1005/2035] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:38.406622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.419407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6162fa9-f3be-4b4a-a174-11fa7756fb56 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.465290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1031/2036] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:38.473469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.474994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.501798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.503066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.503757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.504269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.505657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:38.506206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.515931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.548562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1006/2037] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:38.548562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.551941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.572923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7304-2e9b-46eb-b925-c0fabf51142e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.583652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.584776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.585078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.585407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.586116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.588105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.592355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0a75-5faf-477d-9e16-9954d3955a78 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.597469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.598247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.600129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.600129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.614128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.615726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.630432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1032/2038] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:38.742348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1007/2039] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:38.747573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.766471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86c53-48a4-4b22-8cc8-f7bafe103a7d service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.860969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.863919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.905041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.907882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.908419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.910844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.912115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.914450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.962583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750081-3bf6-4ef2-a574-01ff11cd14d3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.969731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.971336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.971839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.972325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] PATH_INFO: `/v3/projects/21684921f99943819e413c224100cd81` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.973931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21684921f99943819e413c224100cd81)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.976582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.043154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1033/2040] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:39.050014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.068217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61179-d29c-4ad3-a89e-262fc3df03a5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.082667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.083366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.083654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.083965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.084736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.086350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.111698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1034/2041] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:00:39.116502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.151493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef78b-1e8f-4069-9f2f-c31f9d7e9d8d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.164149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21684921f99943819e413c224100cd81', 'request_id': 'req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:39.167491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.178996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21684921f99943819e413c224100cd81', 'request_id': 'req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:39.197490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21684921f99943819e413c224100cd81', 'request_id': 'req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:39.266240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.267241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.267475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.267759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.268510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.270173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.284860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1035/2042] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:39.286025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.298697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d861-4e10-4805-b79e-4926d5a2386a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.308899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.309966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.310412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.313038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] PATH_INFO: `/v3/projects/43a9e28f8e4042aca288e8062ef88cd4/users/c52935d185ee430b9f306ea26f902f1a/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.318546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] The token cache is being invalidate because project 21684921f99943819e413c224100cd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:39.325753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:39.325753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2cfc4ba6-ad14-4caf-beca-3d030ac47a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:39.325753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1008/2043] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:38 2022] DELETE /identity/v3/projects/21684921f99943819e413c224100cd81 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:39.330087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044136-031b-4d92-823f-d06f89b2272c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.330387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044136-031b-4d92-823f-d06f89b2272c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.330778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044136-031b-4d92-823f-d06f89b2272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.354708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a9e28f8e4042aca288e8062ef88cd4, user_id=c52935d185ee430b9f306ea26f902f1a, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.362343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a26a5c-dcc0-4065-9a5c-4e3efb3ab2c7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.376046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-76044136-031b-4d92-823f-d06f89b2272c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:39.378552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-76044136-031b-4d92-823f-d06f89b2272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:39.394482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1009/2044] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:39.402498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.403297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.403712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.435426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:39.437581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:39.460865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1010/2045] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:39.465241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.466597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1036/2046] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:39 2022] PUT /identity/v3/projects/43a9e28f8e4042aca288e8062ef88cd4/users/c52935d185ee430b9f306ea26f902f1a/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:39.480899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.480899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.480899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.524877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52d53-66a3-4427-a5de-c73126faad1b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.556508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] MFA Rules not processed for user `c52935d185ee430b9f306ea26f902f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:39.558069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:39.634289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.634947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.635438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.635859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.637043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:39.637527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.639581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.648708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1037/2047] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:39.660199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.663727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:39.685150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae938-8778-4470-883b-3ed78241f271 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.694938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.695704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.696087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.696513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.699874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.703913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.705265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1011/2048] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:39.714320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.736529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9ed0-b706-45b4-9782-94347eb2fca0 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.742972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.743732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.744027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.744312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.746133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.747117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.871930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1038/2049] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:39.876943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.877764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1012/2050] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:39.884400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.887765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.970570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af4f15-91f4-4da7-bcbd-5c75bd2f26f2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.008104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48511-455e-4e39-bc6a-c34b6addd3c5 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.019348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.020056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.020346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.020642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.021353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.026065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.092958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.093656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.093964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.094361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.095073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.097098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.122997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1013/2051] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:40.129612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.140811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02c50-9390-4884-8fae-5f49d308ac0f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.145605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.146286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.146633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.146850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.147798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.150295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.165834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1014/2052] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:40.168566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.179913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5487-8b1b-474e-b3b4-8f6263a18a6b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.186224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.186883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.187188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.187473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.188212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.190033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.203641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1015/2053] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:00:40.209792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.226253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915b8e-7a15-43ae-99ef-6ef53fbfeff1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.231532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1039/2054] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:39 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:40.240795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.242818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.243175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.243480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] PATH_INFO: `/v3/projects/ca2f621b2f964ea8afba7231469ef50b/users/7de15b3f9aaf4839bc537fa7dfccd471/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.244088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.255224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04aa18-8d47-490f-a038-81bb1885419e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.262599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.263923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.264234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.264553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.265551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.267172 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.276072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2f621b2f964ea8afba7231469ef50b, user_id=7de15b3f9aaf4839bc537fa7dfccd471, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.276458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:40.279072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b494-69d1-470b-831d-35ebf1edc20d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.293217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1040/2055] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:00:40.294418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.306940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464970-4b7d-4120-81b9-f675de432583 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.317245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.318372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.318725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.319079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] PATH_INFO: `/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899/users/a64a2e13ba07416a8515f7b307df492c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.349164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda7fcdcab84fa2ab7a808dc7140899, user_id=a64a2e13ba07416a8515f7b307df492c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.352682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e903a8-06d5-4ce4-9113-b52ea41d503b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.399584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1016/2056] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:40 2022] PUT /identity/v3/projects/ca2f621b2f964ea8afba7231469ef50b/users/7de15b3f9aaf4839bc537fa7dfccd471/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:40.419150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.419150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.419150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.458547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] MFA Rules not processed for user `e135d5a0a42d49149e21189b15fe2834`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:40.459786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.473827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1041/2057] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:40 2022] PUT /identity/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899/users/a64a2e13ba07416a8515f7b307df492c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:40.473827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.473827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.473827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.535381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] MFA Rules not processed for user `7de15b3f9aaf4839bc537fa7dfccd471`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:40.537158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.570636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1017/2058] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:40.571708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.668773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1042/2059] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:40.674635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.678979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.699375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:40.716432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:40.719541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b9c3-489c-43ff-963c-5cad719659f7 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.727124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.728128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.731111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.731111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.731111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.731343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.751282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1018/2060] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:40.751921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.756122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.802782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8b3a6-aac4-4efd-941c-14b2b64af9fc None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.808152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.808873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.809159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.809580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.810234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.812875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.892140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322189-e569-4bcc-9209-39914624eb34 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.896091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.896824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.897353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.897353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.910613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:40.914191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:40.919603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1043/2061] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:40.924309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.927028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1019/2062] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:40.927744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.963081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed05cc9-68aa-4fe3-9878-0ee3adcffbd4 service glance] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.006135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6c46-963a-4999-8eda-0cdd25aae9bf admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.011735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.012659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.012955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.013240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] PATH_INFO: `/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899/users/a64a2e13ba07416a8515f7b307df492c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.015826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda7fcdcab84fa2ab7a808dc7140899, user_id=a64a2e13ba07416a8515f7b307df492c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.018914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168186a-4773-4468-8435-5b32010e5a80 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.032780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1044/2063] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:40 2022] PUT /identity/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899/users/a64a2e13ba07416a8515f7b307df492c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:41.034698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.043998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.046151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.046151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.046151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.046929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.049004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.054796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.055009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.055456 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.097860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] MFA Rules not processed for user `a64a2e13ba07416a8515f7b307df492c`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:41.099083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:41.186667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1020/2064] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:41.188274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.200595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e912-78ed-4a28-a07e-54ad28da6b12 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.210563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1045/2065] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:41.220845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.292471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.293965 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.294332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.294976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.295892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.297861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.314093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1021/2066] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:41.315326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.327556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b405a-f73b-4d5c-87f2-96111e4992fe None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.330308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.333056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:41.333551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.334578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.334948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.335300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] PATH_INFO: `/v3/projects/e9b199a1b2eb46a7802311fe041dd61f/users/d58577a2122a49729726c3ce582ae2d1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.352768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b199a1b2eb46a7802311fe041dd61f, user_id=d58577a2122a49729726c3ce582ae2d1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.355649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.428455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf09e8-0391-4326-9bf4-eb48e367c287 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.432835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.433517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.433809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.434096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.454633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1046/2067] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:41 2022] PUT /identity/v3/projects/e9b199a1b2eb46a7802311fe041dd61f/users/d58577a2122a49729726c3ce582ae2d1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:41.454633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.462706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.464785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.478314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1022/2068] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:41.547559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd783-e7bf-47e4-ac81-1ed86fdf444b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.552592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.553382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.553902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.554122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.554932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.556630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.571906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1047/2069] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:41.573339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.585904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b0aa-5b09-4638-9f5a-7ea2dbac1828 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.590892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.592476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.592744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.593030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] PATH_INFO: `/v3/projects/e9b199a1b2eb46a7802311fe041dd61f/users/d58577a2122a49729726c3ce582ae2d1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.595666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b199a1b2eb46a7802311fe041dd61f, user_id=d58577a2122a49729726c3ce582ae2d1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.598869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fb027-89a0-4e72-817b-f9b238286953 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.618376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1023/2070] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:41 2022] PUT /identity/v3/projects/e9b199a1b2eb46a7802311fe041dd61f/users/d58577a2122a49729726c3ce582ae2d1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:41.654380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.807755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.888896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.891752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:41.974522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3423-3e70-4420-ab20-154aaf130a37 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.052268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.053060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.053408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.053755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.119767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.121337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.133199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1048/2071] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:42.197239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.337499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.339039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.340027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.385422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] MFA Rules not processed for user `d58577a2122a49729726c3ce582ae2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:43.402124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:43.496491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.504162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1024/2072] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:43.519787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.530145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842a3f-c579-45fd-af1e-865d298ecf7b service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.534658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.535331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.535613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.536073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.629280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.631043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:43.638138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.642461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.657328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1049/2073] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:43.736834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c041-1caa-4d41-a4de-740b77121acc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.743808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.744867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.745253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.745601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] PATH_INFO: `/v3/users/da21854a92e44dfa80fed9cda8dabb9c` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.746949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] RBAC: Authorizing `identity:delete_user(user_id=da21854a92e44dfa80fed9cda8dabb9c)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.749930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.960427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da21854a92e44dfa80fed9cda8dabb9c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:43.991165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da21854a92e44dfa80fed9cda8dabb9c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:43.991165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da21854a92e44dfa80fed9cda8dabb9c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:43.991165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da21854a92e44dfa80fed9cda8dabb9c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.120254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-389e2b4e-3865-439f-85af-6541e53520de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da21854a92e44dfa80fed9cda8dabb9c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.134601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1025/2074] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:43 2022] DELETE /identity/v3/users/da21854a92e44dfa80fed9cda8dabb9c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:44.480589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:44.495467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5f37-ded0-4b35-95c6-94c824b08c4d service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:44.568529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:44.568529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:44.568529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:44.568529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] PATH_INFO: `/v3/projects/f5c6190d58d6403fbf8de5f190d795db` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:44.570159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c6190d58d6403fbf8de5f190d795db)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:44.572091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:44.782052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c6190d58d6403fbf8de5f190d795db', 'request_id': 'req-2e957ffe-f18a-463f-b5a7-187a4979ce27'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.885515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c6190d58d6403fbf8de5f190d795db', 'request_id': 'req-2e957ffe-f18a-463f-b5a7-187a4979ce27'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.893710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c6190d58d6403fbf8de5f190d795db', 'request_id': 'req-2e957ffe-f18a-463f-b5a7-187a4979ce27'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.896367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:44.910227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] The token cache is being invalidate because project f5c6190d58d6403fbf8de5f190d795db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:44.910469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.911138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e957ffe-f18a-463f-b5a7-187a4979ce27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:44.913891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1050/2075] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:44 2022] DELETE /identity/v3/projects/f5c6190d58d6403fbf8de5f190d795db => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:44.917704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:44.918251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:44.918433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:44.943071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:44.954678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:45.025523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1026/2076] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:45.034641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4035-83a0-4376-9336-12199a68169d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.035019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4035-83a0-4376-9336-12199a68169d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.035332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4035-83a0-4376-9336-12199a68169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.065556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-82fd4035-83a0-4376-9336-12199a68169d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:45.065556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-82fd4035-83a0-4376-9336-12199a68169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:45.069406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1051/2077] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:45.073703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.085160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d7fe-0874-4c66-8d63-d459a40a8206 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.090060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.090735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.091021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.091301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.092651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:45.092957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.094581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.107713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1027/2078] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:45.112947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4035-83a0-4376-9336-12199a68169d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.122622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4035-83a0-4376-9336-12199a68169d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.129040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.129040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.129218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.129497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.130216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.132218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.279033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1052/2079] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:00:45 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:45.283999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.290634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:45.294465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334bc7b-1c44-4148-aba2-6e53e8a9404b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.354971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.355634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.355919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.356197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.356985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.359964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.457370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1028/2080] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:00:45 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:45.458744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.470068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214eb75-96b9-429e-a0e9-50269bb589d8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.475102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.475780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.476064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.476366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.477166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.478798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.491759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1053/2081] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:45.495877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.516776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7b658-6f05-4928-a6c2-d6ec5d1185c6 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.522070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.522773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.523060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.523335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.524071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.525934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af458645-cc9e-4f46-baa9-2eab6570fd1d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.536543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1029/2082] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:00:45.540992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.552945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d29603-4fb4-4ef5-bdb2-67bfe82053d3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.558046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.558931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.559216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.559496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] PATH_INFO: `/v3/projects/57e31a21bc7748b9b97988d455700753/users/dc6a1e1f4df947b4b947371f151f5669/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.575573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e31a21bc7748b9b97988d455700753, user_id=dc6a1e1f4df947b4b947371f151f5669, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.578560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.624777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1054/2083] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:00:45 2022] PUT /identity/v3/projects/57e31a21bc7748b9b97988d455700753/users/dc6a1e1f4df947b4b947371f151f5669/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:45.630346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.630645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.630931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.650420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:45.652748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:45.741159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1030/2084] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:45.751734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:45.753636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:45.817386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795fd22-e0d3-44f4-905d-e9c2a602c497 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:45.821102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:45.821789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:45.822043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:45.822322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:45.832599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:45.834126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:45.845207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1055/2085] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:46.804101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:46.806475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:46.885068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e2f09-0acd-4196-ace4-63da9b5f9928 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:46.901425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:46.901425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.901711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.901981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:46.903915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:46.991384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.039262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.041065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ad56c-d628-4183-965a-38f2bca780ef service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.054110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1031/2086] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:47.335442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.337458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.353725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2e2af-9e6b-4d9b-ac1b-a8f094c1890a service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.365622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.366867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.367301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.367725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] PATH_INFO: `/v3/users/40e9386d752b49ae9d661ff247b0864a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.369869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e9386d752b49ae9d661ff247b0864a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.372286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.679111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e9386d752b49ae9d661ff247b0864a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:47.683252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e9386d752b49ae9d661ff247b0864a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:47.701862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e9386d752b49ae9d661ff247b0864a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:47.703541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e9386d752b49ae9d661ff247b0864a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:47.786225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e9386d752b49ae9d661ff247b0864a'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:47.825392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1056/2087] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:00:47 2022] DELETE /identity/v3/users/40e9386d752b49ae9d661ff247b0864a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:47.827256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.827757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.827836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.847506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:47.848823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.928247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1032/2088] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:48.139161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.141688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:48.147381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.225631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b36f7-ebfb-4129-8295-9a4f945a6d7e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.233234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.233234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.233234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.233234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.244222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.245892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf121cc0-99b3-4277-b21b-e717a85df455 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.259269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1057/2089] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:48.974379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.976002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:48.988578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bff20e-38e0-44ee-9570-3fc9b9cb2402 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.996016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.996991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.997675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.998023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] PATH_INFO: `/v3/projects/6a25f19f914942f29058c89ddefa0e71` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.012828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a25f19f914942f29058c89ddefa0e71)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:49.016482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:49.241239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a25f19f914942f29058c89ddefa0e71', 'request_id': 'req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:49.249746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a25f19f914942f29058c89ddefa0e71', 'request_id': 'req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:49.257889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a25f19f914942f29058c89ddefa0e71', 'request_id': 'req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:49.368944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] The token cache is being invalidate because project 6a25f19f914942f29058c89ddefa0e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:00:49.369500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:49.370380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:00:49.372501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1033/2090] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:00:48 2022] DELETE /identity/v3/projects/6a25f19f914942f29058c89ddefa0e71 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:52.484121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11e39-1608-47f4-a460-1d5b6646ea88 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.484644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11e39-1608-47f4-a460-1d5b6646ea88 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.484741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11e39-1608-47f4-a460-1d5b6646ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.517275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3ac11e39-1608-47f4-a460-1d5b6646ea88 None None] MFA Rules not processed for user `dc6a1e1f4df947b4b947371f151f5669`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:52.518507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3ac11e39-1608-47f4-a460-1d5b6646ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:52.600826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1058/2091] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:52.627714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.629989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:52.737968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.826233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab0c2c-c563-4544-b2e1-d7a4a0612f45 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.834135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.834933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.835180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.835490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.848110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.853611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.869622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1034/2092] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:00:56.081168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7a0f-4553-434d-806d-1482ed5d3d74 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.082160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7a0f-4553-434d-806d-1482ed5d3d74 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.082615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7a0f-4553-434d-806d-1482ed5d3d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.111137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-613f7a0f-4553-434d-806d-1482ed5d3d74 None None] MFA Rules not processed for user `dc6a1e1f4df947b4b947371f151f5669`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:56.111745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-613f7a0f-4553-434d-806d-1482ed5d3d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:56.120208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1059/2093] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:00.707395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.711896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:00.787518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00156a-9c4e-435a-8a04-8aea4e06f444 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.792304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.793188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.793480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.793764 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] PATH_INFO: `/v3/users/c52935d185ee430b9f306ea26f902f1a` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.796155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52935d185ee430b9f306ea26f902f1a)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.798211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.018869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52935d185ee430b9f306ea26f902f1a'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:01.039208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52935d185ee430b9f306ea26f902f1a'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:01.051833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52935d185ee430b9f306ea26f902f1a'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:01.051833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52935d185ee430b9f306ea26f902f1a'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:01.187932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52935d185ee430b9f306ea26f902f1a'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:01.206893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1035/2094] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:00 2022] DELETE /identity/v3/users/c52935d185ee430b9f306ea26f902f1a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:01.211164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.211677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.211782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.244919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:01.246133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:01.350461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1060/2095] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:01.361468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.363865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:01.418161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.440602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3046497-90b7-4903-806f-fcfc0ab1dc11 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.444362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.445150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.445549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.446183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.457469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.459144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.470116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1036/2096] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:02.225859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.228899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:02.281221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27a05-9fe8-408b-bfd6-8dbfadd0a09d None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.296129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.296129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.296129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.296129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] PATH_INFO: `/v3/projects/43a9e28f8e4042aca288e8062ef88cd4` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.297114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a9e28f8e4042aca288e8062ef88cd4)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.297933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.339084 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.479034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a9e28f8e4042aca288e8062ef88cd4', 'request_id': 'req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.579070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a9e28f8e4042aca288e8062ef88cd4', 'request_id': 'req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.585986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a9e28f8e4042aca288e8062ef88cd4', 'request_id': 'req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.597781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] The token cache is being invalidate because project 43a9e28f8e4042aca288e8062ef88cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:02.598075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.598929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.600583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1061/2097] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:02 2022] DELETE /identity/v3/projects/43a9e28f8e4042aca288e8062ef88cd4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:02.604714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.615824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edb7d-ed36-4731-83ef-57ff39768732 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.703357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.704270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.704561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.704888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] PATH_INFO: `/v3/users/a64a2e13ba07416a8515f7b307df492c` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.706215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64a2e13ba07416a8515f7b307df492c)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.708246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.933027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64a2e13ba07416a8515f7b307df492c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.947560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64a2e13ba07416a8515f7b307df492c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.948443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64a2e13ba07416a8515f7b307df492c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:02.949120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64a2e13ba07416a8515f7b307df492c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.040243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-56c7b2e6-e09f-4ef8-9bac-dadacf36e7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64a2e13ba07416a8515f7b307df492c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.061124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1037/2098] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:02 2022] DELETE /identity/v3/users/a64a2e13ba07416a8515f7b307df492c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:03.505259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.507043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:03.526119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12dc96-7d4f-49dc-b7e9-f1fbded4a0f6 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.587173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.588081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.588371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.588810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] PATH_INFO: `/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.590023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eda7fcdcab84fa2ab7a808dc7140899)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.592708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:03.733788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eda7fcdcab84fa2ab7a808dc7140899', 'request_id': 'req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.807117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eda7fcdcab84fa2ab7a808dc7140899', 'request_id': 'req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.814662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eda7fcdcab84fa2ab7a808dc7140899', 'request_id': 'req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.826435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] The token cache is being invalidate because project 2eda7fcdcab84fa2ab7a808dc7140899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:03.826787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.827417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b9de2ae7-55d3-4da5-9738-6cc1a3a92467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:03.829139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1062/2099] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:03 2022] DELETE /identity/v3/projects/2eda7fcdcab84fa2ab7a808dc7140899 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:03.836445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.837000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.837451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.857238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:03.858386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:03.921295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:03.931080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1038/2100] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:03.939448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.939922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.940145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.960017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:03.961281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:03.969813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1063/2101] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:03.975837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.986298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fb02f-23be-4f28-b6e7-71b2f5a0034f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.991011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.994054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.994054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.994054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.994054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:03.994054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.995161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.007848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1039/2102] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:04.012398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.023355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34aaa-852a-4807-b906-8923f2caecf2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.028476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.029927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.030212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.030491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.031205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.033204 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.132112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1064/2103] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:04 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:04.137253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.151085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24c48-d09b-44d8-819d-0b35b321e184 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.265804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.266499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.266788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.267072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.267837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.269866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.364525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1040/2104] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:04 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:04.369139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.385521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d53c-1b5e-4808-933a-5c200e1806ea admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.400068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.400068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.400068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.400068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.400669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.400669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.414436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1065/2105] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:04.420554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.432414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6327-4cfe-4e21-9342-0fa872f85712 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.441045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.441731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.442017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.442301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.443127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.445496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff05b8-0820-4d87-aad3-21b77e100191 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.463538 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1041/2106] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:04.469704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.475382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.481207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad1cd-1cd7-4417-bd12-967a8164e52f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.487675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.488721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.489023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.489313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] PATH_INFO: `/v3/projects/c05658c4d31b444a90ecc0c18530f015/users/2d0efe547a524115be0741a14ac6e58f/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.507652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05658c4d31b444a90ecc0c18530f015, user_id=2d0efe547a524115be0741a14ac6e58f, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.510780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.656215 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1066/2107] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:04 2022] PUT /identity/v3/projects/c05658c4d31b444a90ecc0c18530f015/users/2d0efe547a524115be0741a14ac6e58f/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:04.668880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.669851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.670151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.704503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] MFA Rules not processed for user `2d0efe547a524115be0741a14ac6e58f`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:04.706674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:04.799044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1042/2108] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:04.804198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.914354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fc11-02c3-444c-a839-1da3144131a5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.918312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.920737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.921212 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.921609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.922533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.924603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.059393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1067/2109] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:04 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:05.065776 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.079800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbdbf-fe53-4c4d-96b2-7a0b67c2bc62 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.134850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.144250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.144974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.145264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.145546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.146250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.148219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.310930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1043/2110] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:05 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:05.314859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.325595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ab2c-ce22-409f-b294-f7e7d258b6d7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.330340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.331146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.331504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.331826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.332602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.334230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.347590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1068/2111] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:05.351847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.364055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c2cc-dc64-4e15-a921-9edf99c91957 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.370033 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.381809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.381809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.381809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] PATH_INFO: `/v3/projects/0aec74b9979241deb2adad92788508aa/users/d0af7b1a961640d3bbbe0b5086cd1b98/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.390440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aec74b9979241deb2adad92788508aa, user_id=d0af7b1a961640d3bbbe0b5086cd1b98, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.393341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.503850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1044/2112] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:05 2022] PUT /identity/v3/projects/0aec74b9979241deb2adad92788508aa/users/d0af7b1a961640d3bbbe0b5086cd1b98/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:05.507811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.519186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c40e4-c696-4980-aaa1-5bcbfab44220 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.580846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.581638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.581812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.582209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.582817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.584432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ca4d2-f24a-47b9-83cb-50f69d39349f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.596193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1069/2113] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:05.598741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.610311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ed84-11f5-4fb5-8b6d-5adc007c22a9 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.615173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.616065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.616376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.616695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] PATH_INFO: `/v3/projects/0aec74b9979241deb2adad92788508aa/users/d0af7b1a961640d3bbbe0b5086cd1b98/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.618647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aec74b9979241deb2adad92788508aa, user_id=d0af7b1a961640d3bbbe0b5086cd1b98, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.621626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.633320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1045/2114] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:05 2022] PUT /identity/v3/projects/0aec74b9979241deb2adad92788508aa/users/d0af7b1a961640d3bbbe0b5086cd1b98/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:05.648100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.648393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.648772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.676603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] MFA Rules not processed for user `d0af7b1a961640d3bbbe0b5086cd1b98`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:05.685405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:05.717554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.748114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1070/2115] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:05.760198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.763263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:05.822535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3836a-d30f-428a-86d3-51ff926561a3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.827486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.828140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.828432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.828747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.837839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.839278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4200ca-54c2-4059-9ed0-994b1a7a809b service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.849270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1046/2116] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:09.515938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.583733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709f344-6929-4d2c-8bf3-cd944716501c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.588507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.589416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.589697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.589973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] PATH_INFO: `/v3/users/2d0efe547a524115be0741a14ac6e58f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.591802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0efe547a524115be0741a14ac6e58f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.593752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.871038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0efe547a524115be0741a14ac6e58f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:09.871733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0efe547a524115be0741a14ac6e58f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:09.882660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0efe547a524115be0741a14ac6e58f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:09.883414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0efe547a524115be0741a14ac6e58f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:10.035467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0efe547a524115be0741a14ac6e58f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:10.066300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1071/2117] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:09 2022] DELETE /identity/v3/users/2d0efe547a524115be0741a14ac6e58f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:10.071046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.071480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.071568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.090457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:10.092584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:10.166444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1047/2118] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:10.176790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.182576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:10.277516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c30626-a6d0-4f82-9f8e-87785fc77e56 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.283137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.284459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.284840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.285338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.296104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.302436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.303990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.319873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1072/2119] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:10.906386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.908112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:10.923185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f562-8cdf-409b-85cb-61f1e810c9cf None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.928375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.929505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.929792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.930074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] PATH_INFO: `/v3/projects/c05658c4d31b444a90ecc0c18530f015` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.931833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05658c4d31b444a90ecc0c18530f015)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.937410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.078296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.082967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05658c4d31b444a90ecc0c18530f015', 'request_id': 'req-2e4352e6-c02f-464b-a122-cf2beeef9300'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.092999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05658c4d31b444a90ecc0c18530f015', 'request_id': 'req-2e4352e6-c02f-464b-a122-cf2beeef9300'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.099448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05658c4d31b444a90ecc0c18530f015', 'request_id': 'req-2e4352e6-c02f-464b-a122-cf2beeef9300'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.258232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] The token cache is being invalidate because project c05658c4d31b444a90ecc0c18530f015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:11.258544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.259271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2e4352e6-c02f-464b-a122-cf2beeef9300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.261118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1048/2120] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:10 2022] DELETE /identity/v3/projects/c05658c4d31b444a90ecc0c18530f015 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:11.267095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.277787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944a6e-43dd-45e8-b2f7-225bc3a5968b service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.373489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.374475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.374771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.375126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] PATH_INFO: `/v3/users/d0af7b1a961640d3bbbe0b5086cd1b98` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.377184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0af7b1a961640d3bbbe0b5086cd1b98)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.379351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.671410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0af7b1a961640d3bbbe0b5086cd1b98'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.672050 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0af7b1a961640d3bbbe0b5086cd1b98'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.679733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0af7b1a961640d3bbbe0b5086cd1b98'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.680631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0af7b1a961640d3bbbe0b5086cd1b98'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.851153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-11112b73-f3ba-42ef-94fa-980edeb496c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0af7b1a961640d3bbbe0b5086cd1b98'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:11.880448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1073/2121] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:11 2022] DELETE /identity/v3/users/d0af7b1a961640d3bbbe0b5086cd1b98 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:12.178915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.179456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.179548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.188077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1049/2122] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 15:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:12.193069 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.193652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.194324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.292650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] MFA Rules not processed for user `e7ab313dcca44094b7f445a9a46eb170`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:12.294966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:12.357571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.401536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1074/2123] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:12.413742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.418277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:12.443605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824443-86bb-4bf2-8330-5b5e469848a6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.449781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.469521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.470055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.470551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.485644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.488123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01233a-111a-4892-a37b-e0cc3a11be81 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.490577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.496535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:12.509002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1050/2124] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:12.655102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8175-b1f6-427a-8334-ff9956f388e5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.666960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.668573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.669756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.670240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] PATH_INFO: `/v3/projects/0aec74b9979241deb2adad92788508aa` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.672313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aec74b9979241deb2adad92788508aa)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.675959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.874506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aec74b9979241deb2adad92788508aa', 'request_id': 'req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:12.942487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aec74b9979241deb2adad92788508aa', 'request_id': 'req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:12.949796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aec74b9979241deb2adad92788508aa', 'request_id': 'req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:12.967260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] The token cache is being invalidate because project 0aec74b9979241deb2adad92788508aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:12.967569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:12.968512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-633d5e0f-8267-4f01-be6b-6d6c5ae61dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:12.971238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1075/2125] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:12 2022] DELETE /identity/v3/projects/0aec74b9979241deb2adad92788508aa => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:12.978100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.978301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.978582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.997543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:12.998849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.078897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1051/2126] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:13.087256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.087675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.087886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.110480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:13.111988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.146328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1076/2127] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:13.150738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.163826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281d4b9-d091-428b-9651-0e79df594ca0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.169539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.170586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.171046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.171407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.172304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:13.172895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.175403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.191516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1052/2128] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:13.197891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.209932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407ef3c-a9d3-466d-bee7-b6fec6884f32 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.215226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.217227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.217534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.217815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.218572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.220458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.263744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.265893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.283245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e133-c13c-4653-81f9-3b56220d52df admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.290908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.292037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.292409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.292889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] PATH_INFO: `/v3/users/e135d5a0a42d49149e21189b15fe2834` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.295561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e135d5a0a42d49149e21189b15fe2834)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.298792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.365038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1077/2129] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:13.370440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.443756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259803ea-cdde-49d2-aaf1-832d24b3cdfc admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.448959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.449640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.449930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.450340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.451139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.453111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.607973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1078/2130] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:13.609060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e135d5a0a42d49149e21189b15fe2834'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:13.612289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.621880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e135d5a0a42d49149e21189b15fe2834'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:13.622958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c973-113a-44e3-b4ba-56e1f0a5ab2d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.623356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e135d5a0a42d49149e21189b15fe2834'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:13.623993 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e135d5a0a42d49149e21189b15fe2834'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:13.628063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.628751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.629039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.630960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.630960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.631886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.643634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1079/2131] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:01:13.649929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.651638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.667122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b71c6-65b1-4eb6-ab58-67fb78de6e9c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.677034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.677740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.678070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.678352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.687318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.687318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.693345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1080/2132] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:01:13.696815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.708273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ebaf3-d75b-469b-8a43-200b4f610753 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.713190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.714082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.714368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.714647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] PATH_INFO: `/v3/projects/8e47caa53b604729b949f9bd3ac02f2c/users/ac8bda71adc44fea830078b4f12293dc/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.730454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e47caa53b604729b949f9bd3ac02f2c, user_id=ac8bda71adc44fea830078b4f12293dc, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.733705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.784574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f80b0ab8-ca72-43cd-bff2-cea3467aa5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e135d5a0a42d49149e21189b15fe2834'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:13.802191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1053/2133] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:13 2022] DELETE /identity/v3/users/e135d5a0a42d49149e21189b15fe2834 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:13.819999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1081/2134] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:13 2022] PUT /identity/v3/projects/8e47caa53b604729b949f9bd3ac02f2c/users/ac8bda71adc44fea830078b4f12293dc/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:13.834854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.835307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.835815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.847165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.873647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] MFA Rules not processed for user `ac8bda71adc44fea830078b4f12293dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:13.874786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.881069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.964976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1054/2135] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:13.976405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.978389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:14.043010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c6dc-c219-4f6f-a0f9-15a47ea9b64b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.047306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.047964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.048254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.048540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.057582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.059019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.069185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1082/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:14.093516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:14.131617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:14.133396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:14.184697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef123c0-cf01-4d29-83c1-aa1ce6989cb9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.191971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.193138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.193510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.193955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] PATH_INFO: `/v3/users/ac8bda71adc44fea830078b4f12293dc` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.195732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8bda71adc44fea830078b4f12293dc)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.197996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.228198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2592e6-8048-40f3-84d0-764467866513 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.235612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.236504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.236828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.237110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] PATH_INFO: `/v3/projects/6e9fcaaf4cf34da49216c546dcfa9432` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.238354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9fcaaf4cf34da49216c546dcfa9432)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.240281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.446190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8bda71adc44fea830078b4f12293dc'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.452317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9fcaaf4cf34da49216c546dcfa9432', 'request_id': 'req-d2ab83f6-8553-49bd-87a2-36637ec8db36'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.459643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8bda71adc44fea830078b4f12293dc'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.460403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8bda71adc44fea830078b4f12293dc'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.461177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8bda71adc44fea830078b4f12293dc'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.546033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:14.572788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9fcaaf4cf34da49216c546dcfa9432', 'request_id': 'req-d2ab83f6-8553-49bd-87a2-36637ec8db36'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.580632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9fcaaf4cf34da49216c546dcfa9432', 'request_id': 'req-d2ab83f6-8553-49bd-87a2-36637ec8db36'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.591411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] The token cache is being invalidate because project 6e9fcaaf4cf34da49216c546dcfa9432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:14.591701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.592393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.594032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1083/2137] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:14 2022] DELETE /identity/v3/projects/6e9fcaaf4cf34da49216c546dcfa9432 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:14.598001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:14.599507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:14.675730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab83f6-8553-49bd-87a2-36637ec8db36 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.680856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.681104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eb52ee00-419d-44f4-ae56-2283cfa94f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8bda71adc44fea830078b4f12293dc'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.681817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.682138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.682625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] PATH_INFO: `/v3/users/d58577a2122a49729726c3ce582ae2d1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.684297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58577a2122a49729726c3ce582ae2d1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.688200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.699742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1055/2138] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:14 2022] DELETE /identity/v3/users/ac8bda71adc44fea830078b4f12293dc => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:14.706284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.706752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.707222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.732148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:14.733418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:14.761108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:14.804961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1056/2139] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:14.815777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:14.818435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:14.901099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840babb-13cf-4763-bdf2-e52f99224697 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.907281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.908003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.908345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.908651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.917990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58577a2122a49729726c3ce582ae2d1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.918665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58577a2122a49729726c3ce582ae2d1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.920787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.922955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.927669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58577a2122a49729726c3ce582ae2d1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.932143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58577a2122a49729726c3ce582ae2d1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:14.936316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1057/2140] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:15.018672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58577a2122a49729726c3ce582ae2d1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.039275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1084/2141] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:14 2022] DELETE /identity/v3/users/d58577a2122a49729726c3ce582ae2d1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:15.470112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.473468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.475713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:15.480123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f099-4d40-4c7e-a7e3-5ba77409950d service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:15.524126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.557267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:15.561225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.561520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.561808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] PATH_INFO: `/v3/projects/e9b199a1b2eb46a7802311fe041dd61f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.563852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b199a1b2eb46a7802311fe041dd61f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:15.566643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:15.604963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019ecc7-7c3d-4cbb-ab1d-4c62a82faaad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:15.610468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:15.611509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.611797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.612082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] PATH_INFO: `/v3/projects/8e47caa53b604729b949f9bd3ac02f2c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.613499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e47caa53b604729b949f9bd3ac02f2c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:15.617841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:15.751217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b199a1b2eb46a7802311fe041dd61f', 'request_id': 'req-431f6b04-5226-4ff1-83a3-78faaa682d31'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.759649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b199a1b2eb46a7802311fe041dd61f', 'request_id': 'req-431f6b04-5226-4ff1-83a3-78faaa682d31'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.776163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b199a1b2eb46a7802311fe041dd61f', 'request_id': 'req-431f6b04-5226-4ff1-83a3-78faaa682d31'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.777749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e47caa53b604729b949f9bd3ac02f2c', 'request_id': 'req-e7ddc094-67ba-4a5c-8e34-581772804382'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.915679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e47caa53b604729b949f9bd3ac02f2c', 'request_id': 'req-e7ddc094-67ba-4a5c-8e34-581772804382'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.926857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e47caa53b604729b949f9bd3ac02f2c', 'request_id': 'req-e7ddc094-67ba-4a5c-8e34-581772804382'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.935715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] The token cache is being invalidate because project 8e47caa53b604729b949f9bd3ac02f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:15.936107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.936918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e7ddc094-67ba-4a5c-8e34-581772804382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:15.938932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1085/2142] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:15 2022] DELETE /identity/v3/projects/8e47caa53b604729b949f9bd3ac02f2c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:15.943977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6c6-3433-4f3d-ab12-a6023b579207 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.944268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6c6-3433-4f3d-ab12-a6023b579207 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.944549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6c6-3433-4f3d-ab12-a6023b579207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.972292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2651f6c6-3433-4f3d-ab12-a6023b579207 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:15.974268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2651f6c6-3433-4f3d-ab12-a6023b579207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:15.993344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.999298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] The token cache is being invalidate because project e9b199a1b2eb46a7802311fe041dd61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:15.999836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:16.000798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-431f6b04-5226-4ff1-83a3-78faaa682d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:16.004323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1058/2143] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:15 2022] DELETE /identity/v3/projects/e9b199a1b2eb46a7802311fe041dd61f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:16.009997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8e37-4c40-47f3-9b0f-2ebb26d4e97a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.010681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8e37-4c40-47f3-9b0f-2ebb26d4e97a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.011900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8e37-4c40-47f3-9b0f-2ebb26d4e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.039420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e7de8e37-4c40-47f3-9b0f-2ebb26d4e97a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.041065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e7de8e37-4c40-47f3-9b0f-2ebb26d4e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.081415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1086/2144] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:16.087988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.087988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.087988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.112719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.116166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.118182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1059/2145] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:16.127783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.128103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.128357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.137022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1087/2146] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:16.141530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.149717 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.150931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.152997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745afd-0ede-4c48-8496-3f390ab2b41f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.161073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.162216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.162728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.163226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.164203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1060/2147] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:16.164582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.165153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.165296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.167611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.175812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80923c4-36e8-4ca5-a627-54fb0d0fe052 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.184437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.185648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.185941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.186229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.186981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.187288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.189220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.191325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1088/2148] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:16.196361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.208554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1061/2149] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:16.211066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0f91-6c04-4d63-bb49-cf8792c5a9fc admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.217372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.225992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.226793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.227156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.227528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.229068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.233399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.233746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4200b-5a32-4630-bdcd-1bf64c36b7c8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.238737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.239433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.239724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.240017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.240830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.242760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.338697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1062/2150] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:16.343259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.367294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1089/2151] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:16.379509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.399328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.416732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c368-cabd-4a84-8aa3-d116fa866784 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.446457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f55c-628e-4414-b422-903918083151 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.455078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.455819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.456113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.456389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.457163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.460469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.485924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.486614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.486900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.487222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.487921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.489896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.578417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1090/2152] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:16.579714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.590027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d72acb-d984-47d3-b0a4-c92404464111 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.595889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.596840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.597284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.597673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.598488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.603865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.614444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1063/2153] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:16.615518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.621552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1091/2154] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:16.623613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.626552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feb908-b94c-43aa-a309-7d80a5569cb7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.633917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.634680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.634841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f0bf1-cfe2-4717-a1c5-a6ff7da76b68 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.635032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.635313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.636042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.637766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.642041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.642190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.642563 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.642898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.643652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.645734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.651987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1064/2155] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:01:16.654462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.661653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1092/2156] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:16.664702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71760590-4e9d-4eb7-9203-341022cdbd52 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.666972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.671952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.672891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.673713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.674220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.675874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.678872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557418c-857f-44c2-a0bd-cc9ed47f34da admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.679187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.685851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.686778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.687068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.687352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] PATH_INFO: `/v3/projects/5d4044e2798b43d6852064b0e529a580/users/16d285f343f6452995b636d414e9ce80/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.698636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1065/2157] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:16.703603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.712936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4044e2798b43d6852064b0e529a580, user_id=16d285f343f6452995b636d414e9ce80, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.716821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8080344-e91d-4394-9a4e-11e0893988e0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.726933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ecf1-0e37-4dc9-997d-0f7196e1d857 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.734556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.735544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.735847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.736186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] PATH_INFO: `/v3/projects/9ad8d5e389f347c68c56a7897cedf2fa/users/213fca90f3f54826884c8e4d11ac9bfa/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.753996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad8d5e389f347c68c56a7897cedf2fa, user_id=213fca90f3f54826884c8e4d11ac9bfa, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.764254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090071a-0106-46b2-8477-099d44b1c0cc admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.802716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1093/2158] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:16 2022] PUT /identity/v3/projects/5d4044e2798b43d6852064b0e529a580/users/16d285f343f6452995b636d414e9ce80/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:16.808165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.808467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.808856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.837481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.838980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.859895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.899702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1066/2159] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:16 2022] PUT /identity/v3/projects/9ad8d5e389f347c68c56a7897cedf2fa/users/213fca90f3f54826884c8e4d11ac9bfa/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:16.901795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.902099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.902390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.938325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1094/2160] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:16.938523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] MFA Rules not processed for user `213fca90f3f54826884c8e4d11ac9bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.939058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.945265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.946802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.019055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bb55-45b1-49f4-939c-5957783e751f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.026494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1067/2161] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:17.041696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.043202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.082482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.083157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.083479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.083760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.117384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a20f7-8bfd-4c01-90f1-ad5c3b82ed3a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.123490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.124797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.125403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.125863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.138891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.141144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.155375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1068/2162] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:17.169810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.171390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e77254-2c3f-4b4c-8e64-f9ad1a07913a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.182446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.186871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1095/2163] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:17.198455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7975e3-871f-492c-af15-9b0ddfe89b14 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.204522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.205577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.205869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.206159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] PATH_INFO: `/v3/users/213fca90f3f54826884c8e4d11ac9bfa` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.207394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] RBAC: Authorizing `identity:delete_user(user_id=213fca90f3f54826884c8e4d11ac9bfa)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.209379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.250713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.437803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.447060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213fca90f3f54826884c8e4d11ac9bfa'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:17.461889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213fca90f3f54826884c8e4d11ac9bfa'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:17.462311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213fca90f3f54826884c8e4d11ac9bfa'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:17.463201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213fca90f3f54826884c8e4d11ac9bfa'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:17.562666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213fca90f3f54826884c8e4d11ac9bfa'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:17.578638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1069/2164] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:17 2022] DELETE /identity/v3/users/213fca90f3f54826884c8e4d11ac9bfa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:17.584589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.585101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.585545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.605436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:17.607465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.686495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1096/2165] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:17.694767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.696533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.790480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30744f6-d267-4da7-b313-30bf83c4055e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.800625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.801500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.801791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.802077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.815601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.817199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d2c37-4819-45c4-ad9e-d6b2ad3b27f7 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.840493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1070/2166] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:18.387149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.389327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:18.410553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845abf-76a3-4d97-913c-eb678c2a0fb6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.423662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.424601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.424933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.425213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] PATH_INFO: `/v3/projects/9ad8d5e389f347c68c56a7897cedf2fa` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.426446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad8d5e389f347c68c56a7897cedf2fa)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.428409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.578428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad8d5e389f347c68c56a7897cedf2fa', 'request_id': 'req-be939f6c-0879-4b8a-a143-e1d1cbc39154'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:18.670355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad8d5e389f347c68c56a7897cedf2fa', 'request_id': 'req-be939f6c-0879-4b8a-a143-e1d1cbc39154'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:18.677946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad8d5e389f347c68c56a7897cedf2fa', 'request_id': 'req-be939f6c-0879-4b8a-a143-e1d1cbc39154'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:18.694907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.702120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] The token cache is being invalidate because project 9ad8d5e389f347c68c56a7897cedf2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:18.702422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:18.703150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-be939f6c-0879-4b8a-a143-e1d1cbc39154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:18.704871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1097/2167] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:18 2022] DELETE /identity/v3/projects/9ad8d5e389f347c68c56a7897cedf2fa => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:18.710180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.710716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.710716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.729957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:18.731264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:18.802653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1071/2168] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:18.811519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.811818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.825854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.831691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:18.832998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:18.841179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1098/2169] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:18.845469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.855372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef5e90-0e94-4b6b-8ad3-1c205afcb2b4 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.860061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.862465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.862465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.862465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.862465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.862465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.864048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.878425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1072/2170] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.882762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.893197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4065f-cb57-45ab-bc8b-a1d8567c69f7 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.897844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.898499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.898783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.899060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.899760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.901721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.026339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1099/2171] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:18 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:19.031388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.042106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae443-cc91-4ff7-826c-7f8185e6291d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.097849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.114020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.114702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.114991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.115276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.116012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.118042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.248816 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1073/2172] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:19 2022] POST /identity/v3/users => generated 281 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:19.253043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.265094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda9f-58ac-4e87-bb89-6cc899053536 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.278889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.279656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.279874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.280158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.280949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.282705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.296512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1100/2173] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:19.299833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.316258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0502-8b46-4ff1-a5a5-cb75b86a7f39 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.322721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.323479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.323841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.324375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.325448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.327362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b3c2-c96b-41f5-a746-014ad7c243e2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.346858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1074/2174] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:19.348135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.369611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238d26-335a-4cec-95ac-85df08aed84f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.381589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.382629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.382979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.384280 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] PATH_INFO: `/v3/projects/7bfdf7a7b41441febf68fba69df70e3e/users/3481545c96d1450bae90e089f3932324/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.408482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfdf7a7b41441febf68fba69df70e3e, user_id=3481545c96d1450bae90e089f3932324, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.411762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13b95-2f92-493c-804e-87eda0f4e401 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.494522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.494731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.495011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.529182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] MFA Rules not processed for user `16d285f343f6452995b636d414e9ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:19.529182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:19.589435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1101/2175] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:19 2022] PUT /identity/v3/projects/7bfdf7a7b41441febf68fba69df70e3e/users/3481545c96d1450bae90e089f3932324/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:19.600409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.600802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.601009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.601833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1075/2176] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:19.613577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.614947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:19.633589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] MFA Rules not processed for user `3481545c96d1450bae90e089f3932324`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:19.635078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:19.680846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9fa7b-9007-4244-9e69-6c99f13a0fc5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.710453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1102/2177] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:19.734202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.739577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.739577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.739577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.801557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.802913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.813132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1076/2178] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:01:20.034839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.034839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:20.047807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3191f4-68e9-4076-83e0-0f79ee59ed75 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.056051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.056051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.056051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.056051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.064757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.066297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f5ebc-293a-4458-93b7-ab39680efcff service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.079196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1103/2179] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:20.093579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.141707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.173682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3821c-fdcd-4399-a0df-817d60e15aa5 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.180948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.180948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.180948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.180948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] PATH_INFO: `/v3/users/3481545c96d1450bae90e089f3932324` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.181670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3481545c96d1450bae90e089f3932324)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.183658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.393648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3481545c96d1450bae90e089f3932324'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:20.406883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3481545c96d1450bae90e089f3932324'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:20.407650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3481545c96d1450bae90e089f3932324'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:20.408261 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3481545c96d1450bae90e089f3932324'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:20.499176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3481545c96d1450bae90e089f3932324'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:20.515155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1077/2180] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:20 2022] DELETE /identity/v3/users/3481545c96d1450bae90e089f3932324 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:20.520378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.520775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.521120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.543191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:20.545798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:20.618937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1104/2181] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:20.629534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.631613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:20.704786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbde2a-0951-49d7-b9c2-6d8ff4a6383a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.708493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.709179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.709462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.709740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.720046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.721516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7660f-ce18-4d10-926d-617cef5208f6 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.731910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1078/2182] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:20.818653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:21.313536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.315173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:21.323263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:21.329666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88261-7548-4870-a2d3-5c10275cd8a6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.334653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.335552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.335911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.336259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] PATH_INFO: `/v3/projects/7bfdf7a7b41441febf68fba69df70e3e` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.338178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfdf7a7b41441febf68fba69df70e3e)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.343710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.476504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfdf7a7b41441febf68fba69df70e3e', 'request_id': 'req-6488dd36-78fa-4a75-b6d9-bca24b63a822'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:21.565335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfdf7a7b41441febf68fba69df70e3e', 'request_id': 'req-6488dd36-78fa-4a75-b6d9-bca24b63a822'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:21.572423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfdf7a7b41441febf68fba69df70e3e', 'request_id': 'req-6488dd36-78fa-4a75-b6d9-bca24b63a822'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:21.583749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] The token cache is being invalidate because project 7bfdf7a7b41441febf68fba69df70e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:21.584040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:21.584776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6488dd36-78fa-4a75-b6d9-bca24b63a822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:21.589786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1105/2183] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:21 2022] DELETE /identity/v3/projects/7bfdf7a7b41441febf68fba69df70e3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:21.594471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.594471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.594471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.610522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:21.611765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:21.676319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1079/2184] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:21.685030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.685482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.685744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.706155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:21.707374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:21.715478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1106/2185] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:21.720410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.730513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826e5b8-da3a-404f-8c27-da2568f558f6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.735976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.736939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.737230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.737511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.738988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:21.738988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.740644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.755878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1080/2186] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.760125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.771506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0acfd-7477-4910-8c7e-3f2328937ab3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.779607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.780552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.780878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.781144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.782109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.783845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.927333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1107/2187] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:21 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:21.931669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.953209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16131-f8e4-4295-8dc8-87774929b2ee admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.014916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.015621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.015911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.016199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.016982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.018935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.134659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1081/2188] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:21 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:22.140043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.151022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6901-2b6b-4dbd-bc7e-226537441467 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.157714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.158422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.158768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.159058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.159796 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.161526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.175781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1108/2189] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:22.177074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.189532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05750eb6-1e67-45e2-8943-61b918a8cb20 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.194640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.195302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.195591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.195917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.196683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.198338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049655e-6418-400a-82e8-c14e0315a776 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.210167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1082/2190] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:22.214419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.224423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca1b4-4597-44a5-99d3-aeaaf68dbe8e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.228953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.229839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.230121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.230401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] PATH_INFO: `/v3/projects/2cabf516039f4b5aa97760db504226d2/users/9e3538bfd7d644d3811dd1897fa28fb2/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.250506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cabf516039f4b5aa97760db504226d2, user_id=9e3538bfd7d644d3811dd1897fa28fb2, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.256137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.384584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1109/2191] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:22 2022] PUT /identity/v3/projects/2cabf516039f4b5aa97760db504226d2/users/9e3538bfd7d644d3811dd1897fa28fb2/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:22.390781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59439-c664-4e78-98cb-82b95686bec2 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.391091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59439-c664-4e78-98cb-82b95686bec2 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.391382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59439-c664-4e78-98cb-82b95686bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.410273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e0b59439-c664-4e78-98cb-82b95686bec2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:22.411675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e0b59439-c664-4e78-98cb-82b95686bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:22.458876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.473698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1083/2192] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:22.486154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.487925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:22.547201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68d36-bda3-44c6-b931-bcc4b7d84529 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.550968 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.551628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.551915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.552196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.563336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.564830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2203c0-2cb7-44ab-81da-f447c59e2264 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.575938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1110/2193] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:22.707901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.708207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.708507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.727172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] MFA Rules not processed for user `16d285f343f6452995b636d414e9ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:22.728750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:22.789274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1084/2194] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:24.313208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bf5a-bb25-477b-9746-a434df09c01d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.313823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bf5a-bb25-477b-9746-a434df09c01d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.313823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bf5a-bb25-477b-9746-a434df09c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.348225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-9865bf5a-bb25-477b-9746-a434df09c01d None None] MFA Rules not processed for user `9e3538bfd7d644d3811dd1897fa28fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:24.349813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9865bf5a-bb25-477b-9746-a434df09c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:24.365590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.427781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1111/2195] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:24.438872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.441548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:24.504653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65cdd-2685-4d58-98eb-aaac93af6dec None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.508557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.509853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.510174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.510482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.520138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.532496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.532496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1085/2196] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:28.550298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352103-4080-47cf-b860-2f28929ad85d None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.550298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352103-4080-47cf-b860-2f28929ad85d None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.550298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352103-4080-47cf-b860-2f28929ad85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.566611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-06352103-4080-47cf-b860-2f28929ad85d None None] MFA Rules not processed for user `9e3538bfd7d644d3811dd1897fa28fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:28.567855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-06352103-4080-47cf-b860-2f28929ad85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:28.575694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1112/2197] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:33.285599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.287055 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:33.310876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747f92-1709-41af-9b2c-8e32abd9415e service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.316565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.317464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.317752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.318064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] PATH_INFO: `/v3/users/7de15b3f9aaf4839bc537fa7dfccd471` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.319283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de15b3f9aaf4839bc537fa7dfccd471)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.321273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.502605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de15b3f9aaf4839bc537fa7dfccd471'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:33.516046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de15b3f9aaf4839bc537fa7dfccd471'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:33.516809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de15b3f9aaf4839bc537fa7dfccd471'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:33.517421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de15b3f9aaf4839bc537fa7dfccd471'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:33.583994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de15b3f9aaf4839bc537fa7dfccd471'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:33.598167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1086/2198] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:33 2022] DELETE /identity/v3/users/7de15b3f9aaf4839bc537fa7dfccd471 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:33.602911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.603371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.603519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.622475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:33.623687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:33.686766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1113/2199] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:33.697676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.699108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:33.713771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:33.759974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3d0b-2be9-43e7-a200-1129f8727572 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.763667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.764320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.764905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.765212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.774829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.776311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d7d7f-9a4e-402a-a27a-1557300d8c3b service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.786721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1087/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:34.263367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.263367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:34.283009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48d6ed-6dea-4016-bd99-e128fe94d5cf None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.287980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.288936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.289239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.289988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] PATH_INFO: `/v3/projects/ca2f621b2f964ea8afba7231469ef50b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.291640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2f621b2f964ea8afba7231469ef50b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.295009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.429454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2f621b2f964ea8afba7231469ef50b', 'request_id': 'req-48556930-4023-4554-8bee-3ed9e204849d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:34.509680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2f621b2f964ea8afba7231469ef50b', 'request_id': 'req-48556930-4023-4554-8bee-3ed9e204849d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:34.518108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2f621b2f964ea8afba7231469ef50b', 'request_id': 'req-48556930-4023-4554-8bee-3ed9e204849d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:34.531854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] The token cache is being invalidate because project ca2f621b2f964ea8afba7231469ef50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:34.532137 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:34.532851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-48556930-4023-4554-8bee-3ed9e204849d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:34.534423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1114/2201] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:34 2022] DELETE /identity/v3/projects/ca2f621b2f964ea8afba7231469ef50b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:34.539390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.539893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.539995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.558980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:34.560219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:34.624397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1088/2202] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:34.632528 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.633042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.633127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.652861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:34.654104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:34.663406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1115/2203] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:34.667712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.678214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf041c-5aca-4ef1-a94c-fe7dc1bbdee7 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.682914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.683602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.683893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.684352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.684976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:34.685293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.687737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.705206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1089/2204] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:34.709741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.719419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bae1b-4ef4-4873-a773-fc55be6b4cad None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.724108 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.724801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.725086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.728998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.728998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.728998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.836811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1116/2205] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:01:34 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:34.840408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.850910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b17b-6f52-43ea-9271-67e96523930b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.919459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.920140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.920430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.920796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.921580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.923528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.029287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1090/2206] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:01:34 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:35.034387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.041603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.045468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365f1a-2da9-4afb-8f69-e668ba94c7ab admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.051022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.051725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.052017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.052289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.053053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.054689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.067864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1117/2207] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:35.072335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.083021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87961-bd48-4055-bb25-3cbeb1823cc4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.087903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.088587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.095248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.095248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.095248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.095248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaaf0a-1c42-466d-b09b-c1780d567022 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.102240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1091/2208] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:35.106679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.119188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539f0e-e9d9-403c-8cdf-99e0f98684fa admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.125163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.129963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.129963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.129963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] PATH_INFO: `/v3/projects/fd47eb29179340878f6a6e42ea41479c/users/b8340172503249d8996652d6367fc7b7/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.146648 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd47eb29179340878f6a6e42ea41479c, user_id=b8340172503249d8996652d6367fc7b7, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.149519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.227658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1118/2209] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:01:35 2022] PUT /identity/v3/projects/fd47eb29179340878f6a6e42ea41479c/users/b8340172503249d8996652d6367fc7b7/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:01:35.239584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.240004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.240830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.272348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] MFA Rules not processed for user `b8340172503249d8996652d6367fc7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:35.273605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:35.290728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.362921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1092/2210] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:01:35.373937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.380730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:35.444492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c52c0-c628-4306-913d-f108b0ffc29a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.448372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.455730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.455730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.455730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.461076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.462737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cf416-f874-4ff2-81eb-cc01d895a52c service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.473387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1119/2211] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:45.795772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=23 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.911430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:46.824669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:46.903850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee66a02-0ac4-4aa3-9600-d264f2b7e5e0 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:46.909767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:46.910919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:46.911208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:46.911565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] PATH_INFO: `/v3/users/b8340172503249d8996652d6367fc7b7` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:46.912885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8340172503249d8996652d6367fc7b7)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:46.914745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:47.104865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8340172503249d8996652d6367fc7b7'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:47.117616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8340172503249d8996652d6367fc7b7'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:47.118301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8340172503249d8996652d6367fc7b7'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:47.118906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8340172503249d8996652d6367fc7b7'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:47.194880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8340172503249d8996652d6367fc7b7'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:47.208017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1093/2212] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:01:46 2022] DELETE /identity/v3/users/b8340172503249d8996652d6367fc7b7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:47.213232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.213232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.215668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.232514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:47.233784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:47.325403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1120/2213] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:01:47.337712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:47.339149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:47.403367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513cdf6-686d-468e-b451-8822e6f9a521 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:47.407188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:47.407875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.408165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.408450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.418915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:47.420492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:47.431893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1094/2214] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:48.157276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.158766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:48.170777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c7121-4b83-4f54-9168-6bda6f4b7831 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.175750 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.176674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.176967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.177905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] PATH_INFO: `/v3/projects/fd47eb29179340878f6a6e42ea41479c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.179338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd47eb29179340878f6a6e42ea41479c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.182641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.310337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd47eb29179340878f6a6e42ea41479c', 'request_id': 'req-6018ec9e-850c-4ffd-8907-92c7f3cee911'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:48.361596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd47eb29179340878f6a6e42ea41479c', 'request_id': 'req-6018ec9e-850c-4ffd-8907-92c7f3cee911'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:48.370177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd47eb29179340878f6a6e42ea41479c', 'request_id': 'req-6018ec9e-850c-4ffd-8907-92c7f3cee911'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:48.383189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] The token cache is being invalidate because project fd47eb29179340878f6a6e42ea41479c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:01:48.383489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:48.384173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6018ec9e-850c-4ffd-8907-92c7f3cee911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:01:48.385835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1121/2215] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:01:48 2022] DELETE /identity/v3/projects/fd47eb29179340878f6a6e42ea41479c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:55.903233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.905086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:55.933520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.983690 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5ae81-8e92-4599-ad60-05c27c5625b8 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.046323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.046990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.047279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.047562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.049434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:56.063815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.066496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb463e-802b-4d78-b45a-94db8ebf446c service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.077243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1095/2216] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:58.381506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.204189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3d9b-e10d-4d38-b6f1-20c14922acd4 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.206700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3d9b-e10d-4d38-b6f1-20c14922acd4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.206700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3d9b-e10d-4d38-b6f1-20c14922acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.225303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-51ec3d9b-e10d-4d38-b6f1-20c14922acd4 None None] MFA Rules not processed for user `b7885ae5d9de498d8664da4bab204987`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:00.226543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-51ec3d9b-e10d-4d38-b6f1-20c14922acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:00.293782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1122/2217] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:03.445960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.446543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.446648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.466014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] MFA Rules not processed for user `9e3538bfd7d644d3811dd1897fa28fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:03.467415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:03.533699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1096/2218] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:02:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:10.287455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=25 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:13.525411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=73 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.803055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377957e1-56c2-44b9-a6bc-7321283947d7 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.803578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377957e1-56c2-44b9-a6bc-7321283947d7 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.803766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377957e1-56c2-44b9-a6bc-7321283947d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.857736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-377957e1-56c2-44b9-a6bc-7321283947d7 None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:51.857736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-377957e1-56c2-44b9-a6bc-7321283947d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:51.939699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1123/2219] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:51.988393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.992944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:52.105162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7bcd-de1d-40c2-8a9b-97692fb1e6af None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.111952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.112356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.112662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.112946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.121566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.123166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.132882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1097/2220] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:02:53.123495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:53.123967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:53.124060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:53.161457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] MFA Rules not processed for user `09cd0b66ae0145cb9e533335e23e2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:53.165014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:53.336266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1124/2221] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:02.129284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=41 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.327335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=65 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.424309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.425972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.493019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201b02-d5df-4dae-80c8-6129f5f53ff2 service swift] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.496737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.497397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.510749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.510749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.510749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.595093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.596589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.610017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1098/2222] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:50.981816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.992990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b6c4-7e3d-4b3f-b415-a8a1750aaec0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.997021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.997690 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.997983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.998266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.000468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.016437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.018173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.030309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1125/2223] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:00.603527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=54 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.024933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:38.662107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:38.663691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:38.678476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5146d-cb03-4e9a-a451-02165d7f263f service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:38.684298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:38.684995 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:38.685273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:38.685897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:38.687675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:38.698769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:38.700465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:38.710930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1099/2224] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:04:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:48.706617 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:52.773327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:52.782352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be32d92-467a-4c07-8461-a772f8441677 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:52.786194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:52.786854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:52.790861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:52.790861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:52.790861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:52.800560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:52.802076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:52.811848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1126/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:02.806742 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:37.202223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:37.209727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.218957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9fc0-68c7-4db1-b225-b4a33c3698bb service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:37.224554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:37.225245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:37.225536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:37.225847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:37.227680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.292021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:37.293828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:37.303237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1100/2226] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:05:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:38.661777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:38.675305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2c81-f516-4e40-8f15-dad9c2d1b2f4 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:38.681699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:38.682352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:38.682642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:38.682926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:38.684801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:38.695999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:38.698016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:38.708036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1127/2227] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:42.708738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:42.721948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f75dba-c458-4d78-9bd0-c3219398d1d0 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:42.727930 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:42.734537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:42.734537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:42.734537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:42.734537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:42.745218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:42.747002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:42.762709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1101/2228] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:48.703379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.098694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:52.100284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:52.159200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2aeeb-ed3c-4727-8595-2fd4289be079 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:52.162786 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:52.163443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:52.163728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:52.164006 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:52.165823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:52.234631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:52.237124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:52.251190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1128/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:52.755027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=34 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:02.244730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=48 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:19.342464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:19.353663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76941-c6bd-414c-89d8-2d7e43a3c442 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:19.359018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:19.359726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:19.360014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:19.360295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:19.362309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:19.436731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:19.438193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:19.447978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1102/2230] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:23.990286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:24.000564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8103273-55e0-4ca9-94ce-6ebfee801066 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:24.004425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:24.005117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:24.005406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:24.005693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:24.007758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:24.022503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:24.023954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:24.034581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1129/2231] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:29.445105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=28 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:34.029653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:58.050348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:58.051714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:58.068054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62db3-ddcd-4d3e-ac64-8bd9a1c82924 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:58.073142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:58.073864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:58.074154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:58.074430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:58.083560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:58.085245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857732-1cd9-4f7b-b805-3c0e81801e05 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:58.095249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1103/2232] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:08.090827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:51.522053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:51.523495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:51.539550 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6498-9a72-4511-9a00-911ae5cc21b1 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:51.543950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:51.544602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:51.544918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:51.545200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:51.557032 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:51.558471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:51.569633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1130/2233] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:01.564580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:09.459433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:09.460232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:09.460232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:09.478509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:09.479898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:09.487172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1104/2234] 10.222.0.57 () {58 vars in 967 bytes} [Wed May 25 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:09.660783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:09.671802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55366172-8bef-4fa6-ab70-68cf0672f248 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:09.676767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:09.677398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:09.677687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:09.677966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:09.686852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:09.688425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:09.697375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1131/2235] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 15:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:09:11.006427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:11.016644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06ddf2-bfd0-4b36-8e7f-f6e536e1a5bc None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:11.020749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:11.021583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:11.021939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:11.022317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:11.024243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:11.101604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:11.103302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:11.113050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1105/2236] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:11.645403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:11.658531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9ec95-78e7-4547-ab43-cb356d1ed920 service swift] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:11.665663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:11.666380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:11.666671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:11.667131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:11.669020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:11.682610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:11.684301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:11.697161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1132/2237] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:11.777431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:11.778966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:11.792092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46eb61-ec5d-4709-b60c-546a54ca2883 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:11.797131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:11.798010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:11.798335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:11.798658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] PATH_INFO: `/v3/users/9e3538bfd7d644d3811dd1897fa28fb2` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:11.799755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3538bfd7d644d3811dd1897fa28fb2)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:11.801720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:12.041126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3538bfd7d644d3811dd1897fa28fb2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.053191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3538bfd7d644d3811dd1897fa28fb2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.053885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3538bfd7d644d3811dd1897fa28fb2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.054624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3538bfd7d644d3811dd1897fa28fb2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.147880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1625e487-7845-4095-b28c-8a8f24d83b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3538bfd7d644d3811dd1897fa28fb2'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.161451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1106/2238] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:09:11 2022] DELETE /identity/v3/users/9e3538bfd7d644d3811dd1897fa28fb2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:12.453510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:12.470956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3928-11fd-48ce-8615-501a32b0ffcc service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:12.544819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:12.545744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.546238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.546526 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] PATH_INFO: `/v3/projects/2cabf516039f4b5aa97760db504226d2` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.547756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cabf516039f4b5aa97760db504226d2)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:12.549800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:12.668551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cabf516039f4b5aa97760db504226d2', 'request_id': 'req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.760277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cabf516039f4b5aa97760db504226d2', 'request_id': 'req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.767150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cabf516039f4b5aa97760db504226d2', 'request_id': 'req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.777659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] The token cache is being invalidate because project 2cabf516039f4b5aa97760db504226d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:12.777945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.778590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5c8e31dd-ada6-4ad7-a52b-32d1f81bbe87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:12.780127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1133/2239] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:09:12 2022] DELETE /identity/v3/projects/2cabf516039f4b5aa97760db504226d2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:12.785758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.786053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.786334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.804157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:12.806748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:12.856242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:12.864574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1107/2240] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:12.873109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.873405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.873692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.892230 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:12.893476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:12.901806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1134/2241] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:12.906146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:12.916927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a77c7-e5d6-4c40-8a9f-4709bc0e182c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:12.923829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:12.924875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.925165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.925483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.926211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:12.926541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:12.928131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:12.942773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1108/2242] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:12.947371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:12.956711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec872be-16ea-402d-86be-e10381c35c5b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:12.961645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:12.962298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.962586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.962869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.963561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:12.965511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.119935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1135/2243] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:09:12 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:13.121215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.131224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d5ac-3dc4-4d37-b63d-e62bf09040a4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.199562 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.200174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.200462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.200844 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.201546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.203485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.361063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1109/2244] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:09:13 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:13.365645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.376043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1288-6558-4550-9322-c1a0a003a1e1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.380557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.381245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.381533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.381812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.382810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.384631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.394419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1136/2245] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:13.398399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.409060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145ba6-7059-4b95-b4da-ec8b94c139c0 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.413696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.415063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.415355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.415642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.416373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.418037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2749-864a-4348-8cf2-f707ec6887a7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.428490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1110/2246] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:13.432885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.442779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323eec1-5687-42d7-be1e-b822c21761a2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.447321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.448194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.448477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.448790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] PATH_INFO: `/v3/projects/9f8450edbe3c4c3bb2b5a862c98f1681/users/a4c22b12a9044ae085b32d4d7a56d086/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.460561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:13.464080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8450edbe3c4c3bb2b5a862c98f1681, user_id=a4c22b12a9044ae085b32d4d7a56d086, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.467063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.595349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1137/2247] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:09:13 2022] PUT /identity/v3/projects/9f8450edbe3c4c3bb2b5a862c98f1681/users/a4c22b12a9044ae085b32d4d7a56d086/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:13.666913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.667211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.667497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.693594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] MFA Rules not processed for user `a4c22b12a9044ae085b32d4d7a56d086`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:13.694808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:13.760956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1111/2248] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:09:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:13.771541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.773377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:13.833885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5b37-3dfe-4eb4-9e19-745c9675b974 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.838379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.839026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.839318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.839597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.848054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.849516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.858246 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1138/2249] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:23.756305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:23.854254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:38.894853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:38.896514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:38.966676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbb2ed-4fbb-4cf6-81b3-7cc07ab49e8b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:38.985010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:38.985010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:38.985010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:38.985010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:38.985390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:39.088913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:39.095272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:39.097684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112bda-fd65-4351-aef7-434ff8d1db7e service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:39.098203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec219c1-045b-418e-9676-49d81fc830e2 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:39.102311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:39.103020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:39.103516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:39.103799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:39.106317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:39.110493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1112/2250] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:39.204505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:39.206119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:39.228132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1139/2251] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:09:43.829961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:43.830459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:43.834318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:43.850278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] MFA Rules not processed for user `dc6a1e1f4df947b4b947371f151f5669`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:43.851871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:43.914879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1113/2252] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:44.233766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:44.243876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0c3c9-3453-49f0-92f7-8cd9c785578b service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:44.247482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:44.248222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.248510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.248817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.250634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.265289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:44.266766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:44.280684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1140/2253] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:44.930864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:44.932430 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.994602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:45.016532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092f51-a4a3-41fc-99f7-6d0a0e656cf4 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:45.021607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:45.022263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:45.022549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:45.023534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:45.025505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:45.037550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:45.039324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:45.049232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1114/2254] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:54.272938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=47 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:54.297113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:54.298546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:54.314875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045426ea-7a5d-4d96-8e49-b0e656a11ff3 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:54.320632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:54.321358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:54.321649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:54.321930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:54.323733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:54.336282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:54.337913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:54.352521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1141/2255] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:54.812594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:54.822760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1695ea2-e617-4634-894a-c2bffa131d58 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:54.826515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:54.827165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:54.827484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:54.827766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:54.829571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:54.841129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:54.843288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:54.854822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1115/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:04.387082 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:04.847989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=17 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:36.117135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:36.140488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9a7c-28ec-433d-831d-ab0c47744714 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:36.144239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:36.144919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:36.145208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:36.145556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:36.147324 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:36.254535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:36.256234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:36.275654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1142/2257] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:10:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:37.107188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:37.137954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ddcf-32f9-450b-8a22-ebbd62ff4afe service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:37.143763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:37.144423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:37.144740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:37.145022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:37.146811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:37.230301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:37.231910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:37.251736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1116/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:42.167197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:42.180876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4056bb-c80b-4670-888a-01da47dfe044 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:42.187176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:42.187840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:42.188126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:42.188535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:42.190571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:42.215760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:42.217655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:42.233294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1143/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:10:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:47.248998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=49 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:52.226049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=66 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:14.614219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:14.643748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2339c-f039-4d87-a7b9-5ffd8eb912a2 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:14.649475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:14.650129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:14.650422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:14.650701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:14.653292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:14.693739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:14.695378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:14.723376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1117/2260] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:19.790762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:19.792139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:19.825499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f079ce-520b-4011-a54b-85bd032d6a39 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:19.829022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:19.830221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:19.830496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:19.830768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:19.832489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:19.912876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:19.914302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:19.938453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1144/2261] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:24.719104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=26 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:29.935583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=50 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:00.685832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:00.707413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139fd4-a2df-4c69-aeed-d0fcaece44f8 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:00.712408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:00.713087 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:00.713378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:00.713661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:00.715413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:00.740274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:00.741898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:00.752001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1118/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:13:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:10.747436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=15 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:13.394180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:13.402784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ed4d-aadb-4207-9f6d-46937d39b9a0 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:13.406450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:13.407096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:13.407385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:13.407671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:13.417975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:13.419410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:13.429392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1145/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:23.425089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:38.791845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:38.802010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabed5f-3f23-4ec9-817f-e1def6eec96e service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:38.805560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:38.806206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:38.806497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:38.806779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:38.816544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:38.818035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:38.826981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1119/2264] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:14:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:48.822896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:52.829758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:52.849496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488bf64-cd31-417b-acaf-14cfd4af7ab8 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:52.856029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:52.856029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:52.856029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:52.856029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:52.866843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:52.868338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:52.880168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1146/2265] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:14:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:00.734735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:00.744194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db48d-b7e3-4e46-a367-56eaf2704307 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:00.748762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:00.749410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:00.749699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:00.750242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:00.758004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:00.759476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033c50b-d029-4cca-b1f1-9e1b1f0e5bc5 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:00.768385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1120/2266] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:02.875261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=10 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:10.764676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:14.632124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:14.718101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51d9a-b03a-49a3-a2e0-b8f2105bdfd6 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:14.723549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:14.724539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:14.724896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:14.725205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] PATH_INFO: `/v3/users/a4c22b12a9044ae085b32d4d7a56d086` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:14.726539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c22b12a9044ae085b32d4d7a56d086)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:14.728887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:14.893187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c22b12a9044ae085b32d4d7a56d086'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:14.893852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c22b12a9044ae085b32d4d7a56d086'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:14.900769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c22b12a9044ae085b32d4d7a56d086'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:14.901402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c22b12a9044ae085b32d4d7a56d086'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:14.961594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c22b12a9044ae085b32d4d7a56d086'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:14.979953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1147/2267] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:15:14 2022] DELETE /identity/v3/users/a4c22b12a9044ae085b32d4d7a56d086 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:14.984510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:14.985065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:14.985166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:15.030223 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:15.031473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:15.093134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1121/2268] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:15.102957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:15.104394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:15.187942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eab1-1801-4051-8bb1-9f11ce5cb7a7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:15.191472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:15.192126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:15.192408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:15.192719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:15.198610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:15.202502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:15.203932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5b009-b179-49aa-9087-2c7939edd531 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:15.213837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1148/2269] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:15:15.631817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:15.633519 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:15.648684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0840e-ffef-490c-9ce3-6573084ec9b8 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:15.656058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:15.656058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:15.656308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:15.656592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] PATH_INFO: `/v3/projects/9f8450edbe3c4c3bb2b5a862c98f1681` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:15.659293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8450edbe3c4c3bb2b5a862c98f1681)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:15.661565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:15.807325 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8450edbe3c4c3bb2b5a862c98f1681', 'request_id': 'req-1e7a2280-ab22-4416-86ea-2d9e594549d9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:15.814480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8450edbe3c4c3bb2b5a862c98f1681', 'request_id': 'req-1e7a2280-ab22-4416-86ea-2d9e594549d9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:15.820565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8450edbe3c4c3bb2b5a862c98f1681', 'request_id': 'req-1e7a2280-ab22-4416-86ea-2d9e594549d9'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:15.911370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] The token cache is being invalidate because project 9f8450edbe3c4c3bb2b5a862c98f1681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:15:15.911667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:15.912298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1e7a2280-ab22-4416-86ea-2d9e594549d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:15:15.913873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1122/2270] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:15:15 2022] DELETE /identity/v3/projects/9f8450edbe3c4c3bb2b5a862c98f1681 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:15.920835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:15.921340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:15.921469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:15.970514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:15.971723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:16.037998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1149/2271] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:16.046285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.046778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.046880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.065363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:16.066602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:16.074474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1123/2272] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:16.079672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.089433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05a44-95ad-460a-9ff7-56fa412294a5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.094929 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.095597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.095884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.096161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.096928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:15:16.097242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.098833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.111179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1150/2273] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:15:16.115788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.125583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec736-1dd5-46d0-aecf-4d83c8519346 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.130245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.130900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.131189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.131471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.132162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.134118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.210767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1124/2274] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:15:16 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:16.215347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.226200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f05d3-7cc0-4ded-9a3a-d0e7d6ffbb7b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.286393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.287102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.287434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.287760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.288575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.290764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.399125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1151/2275] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:15:16 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:15:16.403444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.414102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b809f-a4cd-4be1-a897-1c3f1fe9b056 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.418901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.419566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.419855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.420188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.420951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.422558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.432964 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1125/2276] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:16.440312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.450233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107f9d-789e-4375-8d21-764db2bad10a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.455739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.456395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.456721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.457014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.457737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.459339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e83217-b063-4200-b3c7-c2108b48c764 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.469735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1152/2277] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:16.473750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.484236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7d91-3ce8-4817-9576-9c35d30c9e91 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.488999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.489886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.490174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.490461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] PATH_INFO: `/v3/projects/2e1fa93296b94d14bb2a0a7c3f557cd6/users/744dda05a7ae45eca28291fadeca771e/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.507294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1fa93296b94d14bb2a0a7c3f557cd6, user_id=744dda05a7ae45eca28291fadeca771e, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.510054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.565225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1126/2278] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:15:16 2022] PUT /identity/v3/projects/2e1fa93296b94d14bb2a0a7c3f557cd6/users/744dda05a7ae45eca28291fadeca771e/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:15:16.570285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398fad-1067-4105-b810-7494f6e68d2b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.570584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398fad-1067-4105-b810-7494f6e68d2b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.570894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398fad-1067-4105-b810-7494f6e68d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.593926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-84398fad-1067-4105-b810-7494f6e68d2b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:16.595154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-84398fad-1067-4105-b810-7494f6e68d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:16.628570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:16.658265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1153/2279] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:16.669151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:16.670881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:16.676884 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:16.740723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25046c-848a-4bd7-8b3a-73006204cbc8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:16.743912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:16.744718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:16.745084 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:16.745444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:16.771578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:16.775386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:16.784038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1127/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:22.644680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cb26-e026-4758-9506-844448c068cb None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:22.645218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cb26-e026-4758-9506-844448c068cb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:22.645218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cb26-e026-4758-9506-844448c068cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:22.676316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8a49cb26-e026-4758-9506-844448c068cb None None] MFA Rules not processed for user `744dda05a7ae45eca28291fadeca771e`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:22.677849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8a49cb26-e026-4758-9506-844448c068cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:22.769426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1154/2281] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:22.774188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:22.785722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0daa71-86f8-4112-95f8-0344c9be4ab1 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:22.791089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:22.792936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:22.792936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:22.792936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:22.793403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:22.795342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:22.896509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1128/2282] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:15:22 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:22.897997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49cb26-e026-4758-9506-844448c068cb None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:22.910839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49cb26-e026-4758-9506-844448c068cb None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:23.010166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:23.011035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:23.011430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:23.011602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:23.012295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:23.014355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:23.089695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1155/2283] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:15:22 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:23.094897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:23.106574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf27cd-a9e1-43b2-b9c8-11948630d39e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:23.112739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:23.113947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:23.114507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:23.115059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:23.116397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:23.119398 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:23.135658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1129/2284] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:23.143034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:23.157860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260a50-ad47-4645-9442-a0bfe6766d8b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:23.163807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:23.164747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:23.165036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:23.165316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] PATH_INFO: `/v3/projects/688d2b36891a4786992a2b0bbdb81996/users/7f2270579e2f4f67b4b65c252b125466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:23.182075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d2b36891a4786992a2b0bbdb81996, user_id=7f2270579e2f4f67b4b65c252b125466, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:23.184775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:23.256221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1156/2285] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:15:23 2022] PUT /identity/v3/projects/688d2b36891a4786992a2b0bbdb81996/users/7f2270579e2f4f67b4b65c252b125466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:23.257652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:23.271146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c161a-7675-46b1-9cfa-93fae2f70613 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:23.334280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:23.334949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:23.335233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:23.335510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:23.336231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:23.337861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d09f7d-ec22-46fa-9661-bf00ef9d00f0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:23.347728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1130/2286] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:23.351812 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:23.363854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffcef-c1d6-4d1c-ad34-d47450f5dff7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:23.368952 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:23.370022 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:23.370438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:23.370798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] PATH_INFO: `/v3/projects/688d2b36891a4786992a2b0bbdb81996/users/7f2270579e2f4f67b4b65c252b125466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:23.372962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d2b36891a4786992a2b0bbdb81996, user_id=7f2270579e2f4f67b4b65c252b125466, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:23.376708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:23.387835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1157/2287] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:15:23 2022] PUT /identity/v3/projects/688d2b36891a4786992a2b0bbdb81996/users/7f2270579e2f4f67b4b65c252b125466/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:29.257364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:29.258302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:29.258667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:29.290352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] MFA Rules not processed for user `7f2270579e2f4f67b4b65c252b125466`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:29.291757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:29.357287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:29.372661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1131/2288] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:29.383531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:29.385397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:29.412555 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:29.485653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccbe74-0ddf-47c7-8eb2-d647d93b4836 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:29.493177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:29.493861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:29.494151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:29.494433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:29.566409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:29.568728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:29.585700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1158/2289] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:30.271258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:30.272748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:30.345475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977505cc-c2ea-46c9-a9ec-bba7cee876dd None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:30.352062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:30.352791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:30.353080 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:30.353361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:30.355304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:30.370813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:30.372305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:30.384484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1132/2290] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:37.227830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:37.229273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:37.243920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d74f4-fdd1-427c-9f7b-ff895bd1a4d7 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:37.250639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:37.251400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:37.251781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:37.252161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:37.254272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:37.319309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:37.320953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:37.333693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1159/2291] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:37.490387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:37.491793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:37.561927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1220c-f619-49c7-9b53-d1fe322e007c service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:37.566516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:37.567169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:37.567458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:37.567738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:37.569548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:37.633366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:37.634825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:37.648313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1133/2292] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:47.325745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=81 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:47.646259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=77 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:15.317556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:15.331959 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197785e5-a833-41a0-a56a-300e56664fa1 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:15.336974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:15.337704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:15.338056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:15.338406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:15.340372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:15.420922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:15.422402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:15.433575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1160/2293] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:16:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:20.060675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:20.075768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfc33-f35f-4e96-91d3-7e63ee63c979 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:20.081355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:20.082006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:20.082298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:20.082574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:20.084695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:20.148550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:20.150266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:20.159758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1134/2294] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:25.429466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=28 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:30.155354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=28 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:18.951741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:17:18.966374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea956-e5f1-4504-a42b-75b117a19ecc service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:17:18.972268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:17:18.973181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:17:18.973469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:17:18.973740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:17:18.975764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:17:18.990609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:17:18.992254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:17:19.004858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1161/2295] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:17:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:17:28.999382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:09.028426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:09.029989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:09.106873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f044-bbbf-4ecc-9d16-253df8aa684b service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:09.116761 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:09.117921 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:09.118501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:09.119086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:09.122514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:09.139395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:09.141061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:09.155639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1135/2296] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:18:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:19.151005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=32 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:38.230522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:19:38.242627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268096f-79a6-45ef-9899-c24477f60f8a service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:19:38.252245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:19:38.252926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:19:38.253218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:19:38.253501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:19:38.257503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:38.317377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:19:38.318992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:19:38.328352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1162/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:19:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:19:48.323993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=28 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:52.526863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:19:52.536220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16506324-3af7-4ce2-ae3b-c1de0cf5d981 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:19:52.541735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:19:52.542573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:19:52.543021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:19:52.543441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:19:52.545747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:52.565166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:19:52.566842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:19:52.585038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1136/2298] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:19:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:02.582283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:30.157635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:30.166313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fc6b-4869-4fb0-bf89-454732c875cb service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:30.170268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:30.170934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:30.171225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:30.171508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:30.181351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:30.182824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:30.193143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1163/2299] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:20:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:31.278693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:31.288200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20ab4f-91c7-45e6-b7cc-c19fc2ceec58 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:31.292198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:31.293068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:31.293320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:31.293607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:31.306100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:31.307542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:31.320752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1137/2300] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:37.538190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:37.563346 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3ba-a751-4140-83d3-065c4002ecff service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:37.568097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:37.570693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:37.571064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:37.571356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:37.597556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:37.598993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:37.631314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1164/2301] 10.222.0.57 () {60 vars in 1396 bytes} [Wed May 25 15:20:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:38.479568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:38.499967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6f4f-51da-473f-9469-2bd695e5ce98 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:38.503566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:38.504206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:38.504493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:38.504821 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:38.514456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:38.515900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:38.543675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1138/2302] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:47.628401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=30 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:48.541010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=24 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:21:06.729657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:06.738992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a6e0-aece-4219-83a9-cf5325cd3686 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:06.743430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:06.744184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:06.744468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:06.744782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:06.746590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:06.778092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:06.779543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:06.788354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1165/2303] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:21:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:21:15.636540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:15.638292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:15.649271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4b72-35b8-472c-bf0d-24dcfc3a531a service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:15.652988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:15.653635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:15.653918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:15.654192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:15.663623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:15.665091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:15.694637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1139/2304] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:16.783948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=14 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:21:20.028687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:20.049297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31089acc-01d2-467a-b2f2-ce420f2e421d service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:20.054162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:20.054843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:20.055131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:20.055413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:20.064841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:20.066334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:20.095552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1166/2305] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:25.692192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=13 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:21:30.093001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=17 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:47.414813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:47.462044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ca5d6-219d-4b95-82c2-646a4aa8a7fb service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:47.467846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:47.468574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:47.468892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:47.469170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:47.480941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:47.482684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:47.502237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1140/2306] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:22:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:52.248287 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:52.258614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17147b2f-5501-46e4-b94d-0b3b0a6d3cd4 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:52.262293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:52.262938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:52.263223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:52.263501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:52.265252 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:52.327852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:52.329507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:52.339100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1167/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:56.400306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:56.402480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:56.422205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427cd50-c425-4bdc-83e5-4c4e172b5694 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:56.426329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:56.427062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:56.427357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:56.427640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:56.429814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:56.445842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:56.447465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:56.459384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1141/2308] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:56.566605 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:56.568208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:56.583634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351bd53-bbb2-4798-9f15-7ae47a77021a service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:56.589085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:56.590373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:56.590373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:56.590687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] PATH_INFO: `/v3/users/b7885ae5d9de498d8664da4bab204987` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:56.605754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7885ae5d9de498d8664da4bab204987)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:56.607743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:56.810551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7885ae5d9de498d8664da4bab204987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:56.811213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7885ae5d9de498d8664da4bab204987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:56.819634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7885ae5d9de498d8664da4bab204987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:56.820369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7885ae5d9de498d8664da4bab204987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:56.883657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ceb7f0a7-e9ff-4063-b3e8-046a6e286f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7885ae5d9de498d8664da4bab204987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:56.913967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1168/2309] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:22:56 2022] DELETE /identity/v3/users/b7885ae5d9de498d8664da4bab204987 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:22:57.192637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:57.203652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88c2e-6481-4b82-a9c5-3b2a017a3687 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:57.278025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:57.286841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.286841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.286841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] PATH_INFO: `/v3/projects/8e0a89b147ce4ccaa47f7ae0f2d66fdf` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.299602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0a89b147ce4ccaa47f7ae0f2d66fdf)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:57.301683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:57.409132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0a89b147ce4ccaa47f7ae0f2d66fdf', 'request_id': 'req-e2bf0136-b43f-4265-92b4-ae291e72b7bd'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:57.415801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0a89b147ce4ccaa47f7ae0f2d66fdf', 'request_id': 'req-e2bf0136-b43f-4265-92b4-ae291e72b7bd'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:57.421411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0a89b147ce4ccaa47f7ae0f2d66fdf', 'request_id': 'req-e2bf0136-b43f-4265-92b4-ae291e72b7bd'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:57.516383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] The token cache is being invalidate because project 8e0a89b147ce4ccaa47f7ae0f2d66fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:22:57.516696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:57.517360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e2bf0136-b43f-4265-92b4-ae291e72b7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:57.518910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1142/2310] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:22:57 2022] DELETE /identity/v3/projects/8e0a89b147ce4ccaa47f7ae0f2d66fdf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:22:57.525367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.525663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.525945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.551882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:22:57.551882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:57.596188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:57.607764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1169/2311] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:22:57.616578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.617027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.617251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.642828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:22:57.645803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:57.658720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1143/2312] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:22:57.663634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:57.673809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61223017-6f8b-4943-a350-a044d73966c8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:57.678420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:57.679083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.679373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.679650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.680387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:22:57.680741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:57.682721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:57.694879 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1170/2313] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:22:57.699406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:57.709102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5d492-c378-4476-9277-5cc4cd0b8e2a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:57.713662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:57.714309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.714593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.714872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.715595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:57.717533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:57.741500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:57.867886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1144/2314] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:22:57 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:22:57.872211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:57.883416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fda32-ae3f-41b7-9f09-4664b7d2d51a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:57.943135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:57.943867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:57.944148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:57.944418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:57.945155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:57.947065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:58.025556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1171/2315] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:22:57 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:22:58.029605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:58.040404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a3c53-cce8-4113-8beb-e02b91d08a28 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:58.045433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:58.046136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:58.046422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:58.046698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:58.047966 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:58.050147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:58.060571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1145/2316] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:22:58.065671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:58.075677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99991-abba-445a-924e-82f31d47b67d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:58.081791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:58.082461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:58.082749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:58.083030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:58.083759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:58.085394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e81e7a-e951-400c-8ff7-c17373f45879 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:58.098048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1172/2317] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:22:58.100899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:58.111400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4a827-8dc8-4934-ba7a-2dd2daa18751 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:58.117596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:58.118488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:58.118773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:58.119053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] PATH_INFO: `/v3/projects/a5c3e4c0b071430d99a699085c136760/users/0ade1cfda8244f0689283bc760728ec5/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:58.134667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c3e4c0b071430d99a699085c136760, user_id=0ade1cfda8244f0689283bc760728ec5, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:58.137414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:58.208365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1146/2318] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:22:58 2022] PUT /identity/v3/projects/a5c3e4c0b071430d99a699085c136760/users/0ade1cfda8244f0689283bc760728ec5/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:22:58.223237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:58.223472 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:58.224554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:58.260147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] MFA Rules not processed for user `0ade1cfda8244f0689283bc760728ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:22:58.261432 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:58.329231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1173/2319] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:22:58.339861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:58.341608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:58.409537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573440-0695-4c46-b88a-d78cd9ed92d7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:58.413209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:58.413852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:58.414142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:58.414424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:58.423758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:58.425252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020cd7a-60fa-4196-a547-51a1f2ad25da service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:58.434059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1147/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:08.325782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:08.430049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=48,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:13.972177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:23:13.973709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:14.080725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21dd3d-7964-4f68-9482-98f306814818 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:23:14.087169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:23:14.088841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:14.089139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:14.089426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:14.091307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:14.104334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:23:14.106962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:23:14.117667 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1174/2321] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:24.113657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=41 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:56.095878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:56.100578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:56.100578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:56.138267 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] MFA Rules not processed for user `09cd0b66ae0145cb9e533335e23e2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:23:56.141787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:56.198542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1148/2322] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:23:56.506654 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:23:56.508198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:56.570894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c0726-21cd-445e-ac3d-e52de0148144 service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:23:56.574481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:23:56.578627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:56.578627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:56.578627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:56.578627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:56.587878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:23:56.589345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:23:56.598529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1175/2323] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:57.044813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:23:57.044813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:57.066645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be3b8-88e4-40ad-974d-2f2a209ff098 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:23:57.071751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:23:57.072417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:57.072803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:57.073010 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:57.074838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:57.087495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:23:57.089147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:23:57.100916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1149/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:23:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:24:06.593939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=26 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:07.095159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=39 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:08.632434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:24:08.633821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:24:08.711754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96d207-90cb-405a-a998-cc3d938fe1d2 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:24:08.717738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:24:08.718494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:24:08.718914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:24:08.719266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:24:08.721947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:24:08.736425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:24:08.739387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:24:08.753197 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1176/2325] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:24:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:24:18.748058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=34 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:54.441444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:24:54.461078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207d44-ccdc-4358-b9af-3792d01f171e service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:24:54.464819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:24:54.465468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:24:54.465758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:24:54.466040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:24:54.467877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:24:54.481732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:24:54.483175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:24:54.495242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1150/2326] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:24:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:04.490133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=10 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:25:32.113427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:32.127717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542d43-2c72-4ac8-9d79-675be89868e2 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:32.131615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:32.132282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:32.132573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:32.132897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:32.135013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:32.167155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:32.169731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:32.182129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1177/2327] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:38.759004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:38.780412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d4c36-87dc-4478-9814-f4893a757a9a service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:38.786240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:38.786951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:38.787239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:38.787517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:38.789309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:38.866111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:38.867784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:38.879214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1151/2328] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:41.259489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:41.269870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be5b3-7eee-4f25-85ce-5067ee2f77b6 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:41.273440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:41.274109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:41.274394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:41.274672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:41.276425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:41.359539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:41.361279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:41.382576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1178/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:41.505177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:41.515182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1b192-a607-4684-8ade-a0854c451661 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:41.518920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:41.519568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:41.519859 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:41.520139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:41.522056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:41.541800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:41.544781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:41.564219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1152/2330] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:51.377323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=52 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:25:51.555422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=39 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:26:12.701138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:26:12.710752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7a3f5-5b25-4c6f-8c44-2e681902a93b service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:26:12.714347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:26:12.714987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:26:12.715268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:26:12.715540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:26:12.717288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:26:12.739265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:26:12.740769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:26:12.749434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1179/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:26:22.745917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=11 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:26:42.860827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:26:42.860827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:26:42.874064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1310d-f303-4603-b812-7118c61f0562 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:26:42.881531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:26:42.881531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:26:42.881531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:26:42.881531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:26:42.881969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:26:42.960510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:26:42.962650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:26:42.971852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1153/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:26:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:26:43.042910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:26:43.052328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f09d84-9696-4be0-aabe-4df8348e965f service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:26:43.056314 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:26:43.057002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:26:43.057289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:26:43.057569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:26:43.059378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:26:43.136015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:26:43.137496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:26:43.147019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1180/2333] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:26:52.967676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=33 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:26:53.142556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=33 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:27:42.700961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:27:42.710551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c1213-4a51-433f-8622-2a4282e93a4e service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:27:42.715139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:27:42.715790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:27:42.716079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:27:42.716361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:27:42.718194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:27:42.803521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:27:42.804917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:27:42.824963 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1154/2334] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:27:50.432445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:27:50.433971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:27:50.449794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fac58-03dc-4d1b-9f81-5b37eb467a07 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:27:50.454367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:27:50.455247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:27:50.455534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:27:50.455933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] PATH_INFO: `/v3/users/744dda05a7ae45eca28291fadeca771e` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:27:50.457203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=744dda05a7ae45eca28291fadeca771e)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:27:50.459128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:27:50.656169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744dda05a7ae45eca28291fadeca771e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:50.656825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744dda05a7ae45eca28291fadeca771e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:50.663749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744dda05a7ae45eca28291fadeca771e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:50.665101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744dda05a7ae45eca28291fadeca771e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:50.727777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744dda05a7ae45eca28291fadeca771e'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:50.746277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1181/2335] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:27:50 2022] DELETE /identity/v3/users/744dda05a7ae45eca28291fadeca771e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:27:50.993950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:27:51.004671 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8183-9d66-4fa1-b522-bb6174c966fb service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:27:51.072566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:27:51.073561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:27:51.073914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:27:51.074259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] PATH_INFO: `/v3/projects/2e1fa93296b94d14bb2a0a7c3f557cd6` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:27:51.075477 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1fa93296b94d14bb2a0a7c3f557cd6)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:27:51.077561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:27:51.190229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1fa93296b94d14bb2a0a7c3f557cd6', 'request_id': 'req-d0e75e0a-166c-43d9-995e-7169f3094609'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.197653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1fa93296b94d14bb2a0a7c3f557cd6', 'request_id': 'req-d0e75e0a-166c-43d9-995e-7169f3094609'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.203683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1fa93296b94d14bb2a0a7c3f557cd6', 'request_id': 'req-d0e75e0a-166c-43d9-995e-7169f3094609'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.207270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:27:51.297174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] The token cache is being invalidate because project 2e1fa93296b94d14bb2a0a7c3f557cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:27:51.297461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.298099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.299689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1155/2336] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:27:50 2022] DELETE /identity/v3/projects/2e1fa93296b94d14bb2a0a7c3f557cd6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:27:51.303791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:27:51.305838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:27:51.319051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8b3d-fb75-4917-be59-6b371cd54a2d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:27:51.380107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:27:51.381015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:27:51.381304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:27:51.381582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] PATH_INFO: `/v3/users/7f2270579e2f4f67b4b65c252b125466` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:27:51.395694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2270579e2f4f67b4b65c252b125466)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:27:51.397686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:27:51.557364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2270579e2f4f67b4b65c252b125466'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.558071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2270579e2f4f67b4b65c252b125466'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.565170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2270579e2f4f67b4b65c252b125466'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.567783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2270579e2f4f67b4b65c252b125466'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.640582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2270579e2f4f67b4b65c252b125466'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:51.642020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:27:51.665674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1182/2337] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:27:51 2022] DELETE /identity/v3/users/7f2270579e2f4f67b4b65c252b125466 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:27:51.911426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:27:51.914726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:27:51.926383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75e0a-166c-43d9-995e-7169f3094609 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:27:51.989741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:27:51.990968 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:27:51.991280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:27:51.991594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] PATH_INFO: `/v3/projects/688d2b36891a4786992a2b0bbdb81996` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:27:52.009550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] RBAC: Authorizing `identity:delete_project(project_id=688d2b36891a4786992a2b0bbdb81996)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:27:52.012847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:27:52.162548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688d2b36891a4786992a2b0bbdb81996', 'request_id': 'req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:52.169404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688d2b36891a4786992a2b0bbdb81996', 'request_id': 'req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:52.175149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688d2b36891a4786992a2b0bbdb81996', 'request_id': 'req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:52.248221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] The token cache is being invalidate because project 688d2b36891a4786992a2b0bbdb81996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:27:52.248550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:52.249179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ce7fc0aa-fede-4655-b6cc-ebb15f42724f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:27:52.250735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1156/2338] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:27:51 2022] DELETE /identity/v3/projects/688d2b36891a4786992a2b0bbdb81996 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:28:01.846983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:28:02.244948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:28:19.978639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:28:19.980170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:28:20.059043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6b14-0ea4-42c4-b308-560686f44119 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:28:20.131828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:28:20.133043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:28:20.133571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:28:20.134024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:28:20.136367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:28:20.151944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:28:20.153944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:28:20.168394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1183/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:28:30.160403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=58 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:29:42.030235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:42.030840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:42.030840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:42.063947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] MFA Rules not processed for user `2e88ad2e00984607a96a3e39d35e223d`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:29:42.065336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:42.128441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1157/2340] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:29:42.446377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:42.447799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:42.508724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792aba-11a3-4dc2-aa72-b3bbf1bba9e6 service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:42.512715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:42.514845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:42.514845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:42.514845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:42.515869 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:42.527177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:42.528658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:42.539263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1184/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:29:42.850913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:42.852347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:42.920919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e67d0-d597-4d60-8cad-71327ef77099 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:42.926708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:42.928391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:42.928391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:42.928835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:42.931508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:43.009480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:43.009480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:43.020072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1158/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:29:43.224696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:43.226771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:43.242863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7816-b47b-479a-ab8c-19623fe1abfc service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:43.253177 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:43.253429 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:43.255330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:43.255330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:43.255975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:43.268944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:43.270673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:43.282127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1185/2343] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:29:47.303417 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:47.305283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:47.370132 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:29:47.401668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc90e6-3654-43e9-a6aa-1f477219d60b service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:47.409506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:47.410443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:47.410896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:47.411275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:47.414276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:47.435646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:47.437375 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:47.451817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1159/2344] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:29:53.277704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=32 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:29:54.294307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:54.297911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:54.313025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274fc6-e64f-47ec-b4ae-631e38b899a5 service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:54.319522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:54.320238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:54.320530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:54.320857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:54.322659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:54.336211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:54.337861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:54.349732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1186/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:29:54.864784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:29:54.874856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ed86-1f83-4085-83d4-3a6cfe607c05 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:29:54.878757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:29:54.879414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:29:54.879701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:29:54.879977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:29:54.881812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:29:54.897596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:29:54.899767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:29:54.911952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1160/2346] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:30:04.344219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:30:04.906452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=16 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:30:43.889299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:30:43.891043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:30:43.913417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488884fd-d45e-4585-b477-5b6c989bf6f3 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:30:43.917026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:30:43.917673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:30:43.917956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:30:43.918231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:30:43.919964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:30:44.007569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:30:44.009033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:30:44.028838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1187/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:30:54.026055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=47 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:31:16.748404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:31:16.784333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25326a9-6f68-4392-9acd-0dc676ed6057 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:31:16.789880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:31:16.790569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:31:16.790851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:31:16.791126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:31:16.792905 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:31:16.824420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:31:16.826060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:31:16.844427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1161/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:31:18.686329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:31:18.696443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7849-abf5-4dc7-95db-d7491aab8f43 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:31:18.700080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:31:18.700764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:31:18.701055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:31:18.701338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:31:18.703749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:31:18.725312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:31:18.726759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:31:18.735535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1188/2349] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:31:26.841682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=29 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:31:28.731334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=10 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:31:43.834788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:31:43.853870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16927-b2c5-42aa-bf00-9914f4167915 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:31:43.857771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:31:43.858462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:31:43.859237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:31:43.859514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:31:43.861335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:31:43.930356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:31:43.931803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:31:43.952341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1162/2350] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:31:44.543632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:31:44.552934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c88a-4a15-4107-a026-2301316ce4e4 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:31:44.556503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:31:44.557180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:31:44.558681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:31:44.558681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:31:44.559641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:31:44.634483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:31:44.634769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:31:44.653652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1189/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:31:53.949427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=40 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:31:54.650975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=36 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:32:17.335492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:32:17.347093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fbc3-3b45-46a4-acdf-674aef631463 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:32:17.351467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:32:17.352099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:32:17.352390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:32:17.352700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:32:17.354488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:32:17.370030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:32:17.371474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:32:17.383640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1163/2352] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:32:27.378661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:33:23.973408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:24.001848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198aa9b-fc18-43ee-bd94-ee1aa56c71b6 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:24.007345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:24.007987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:24.008270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:24.008543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:24.017083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:24.019156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:24.028872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1190/2353] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:33:34.024779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=13 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:33:55.404534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:55.406002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:55.416956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b77128-2c70-483e-9b7d-8eb53e989d9f service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:55.420691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:55.421362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:55.421653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:55.426972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:55.426972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:55.488107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:55.489583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:55.499946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1164/2354] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:33:56.132865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:56.134438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:56.248019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4147e3-58df-440c-a912-c32e4222d60e service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:56.251749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:56.252581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:56.252777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:56.253061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:56.255019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application [None req-fc8b115a-c95a-4f6c-9dc4-d1e74f5e0faa service glance] Could not find project: 2e1fa93296b94d14bb2a0a7c3f557cd6.: keystone.exception.ProjectNotFound: Could not find project: 2e1fa93296b94d14bb2a0a7c3f557cd6. May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 25 15:33:56.269219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:33:56.270217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self._validate_token_resources() May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:33:56.271836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application with Lock( May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._enter() May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.creator() May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application created_value = creator( May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:33:56.278567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:33:56.279606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2e1fa93296b94d14bb2a0a7c3f557cd6. May 25 15:33:56.279606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: ERROR keystone.server.flask.application May 25 15:33:56.279606 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1191/2355] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:33:56 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 25 15:33:57.603918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:57.606260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:57.628395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdaced-5faa-4ffb-b0f1-1d5a0df6a414 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:57.644279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:57.645580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:57.647178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:57.647513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] PATH_INFO: `/v3/users/0ade1cfda8244f0689283bc760728ec5` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:57.668140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ade1cfda8244f0689283bc760728ec5)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:57.671194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:57.907812 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ade1cfda8244f0689283bc760728ec5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:57.925782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ade1cfda8244f0689283bc760728ec5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:57.926949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ade1cfda8244f0689283bc760728ec5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:57.928002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ade1cfda8244f0689283bc760728ec5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:58.095670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ade1cfda8244f0689283bc760728ec5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:58.114881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1165/2356] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:33:57 2022] DELETE /identity/v3/users/0ade1cfda8244f0689283bc760728ec5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:33:58.120018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:58.121364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:58.121663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:58.156840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:33:58.158354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:58.259092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1192/2357] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:33:58.300796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:58.303103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:58.376762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3582288-ad44-4269-8cf2-a1b5f5ac2097 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:58.381017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:58.382200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:58.382631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:58.382981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:58.396958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:58.398688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eed85-77c5-4bcc-92a2-f6fba4626611 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:58.404086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:33:58.416586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1166/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:33:59.361687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:59.363273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.383088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251cad-bfa4-4b38-85a7-d70025e3dad0 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:59.388233 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:59.389202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:59.390039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:59.390488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] PATH_INFO: `/v3/projects/a5c3e4c0b071430d99a699085c136760` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:59.413925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c3e4c0b071430d99a699085c136760)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:59.416088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:59.577807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c3e4c0b071430d99a699085c136760', 'request_id': 'req-9d85b70e-60a9-49e3-8842-5357ea068e32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:59.667444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c3e4c0b071430d99a699085c136760', 'request_id': 'req-9d85b70e-60a9-49e3-8842-5357ea068e32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:59.675320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c3e4c0b071430d99a699085c136760', 'request_id': 'req-9d85b70e-60a9-49e3-8842-5357ea068e32'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:59.686223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:33:59.695075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] The token cache is being invalidate because project a5c3e4c0b071430d99a699085c136760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:33:59.695467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:59.696581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:33:59.699036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1193/2359] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:33:59 2022] DELETE /identity/v3/projects/a5c3e4c0b071430d99a699085c136760 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:33:59.713286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5db9d-c12b-4336-b0f4-e64143eb96ff None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:59.713754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5db9d-c12b-4336-b0f4-e64143eb96ff None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:59.714266 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5db9d-c12b-4336-b0f4-e64143eb96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:59.789502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:59.791628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.830863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b1d5db9d-c12b-4336-b0f4-e64143eb96ff None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:33:59.832136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b1d5db9d-c12b-4336-b0f4-e64143eb96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.924851 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1167/2360] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:33:59.926399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b70e-60a9-49e3-8842-5357ea068e32 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:59.926512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:59.926727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:59.927017 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:59.935994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335f74-523b-41ef-bca1-92030613671a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:59.936684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335f74-523b-41ef-bca1-92030613671a service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:59.936976 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335f74-523b-41ef-bca1-92030613671a service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:59.937259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335f74-523b-41ef-bca1-92030613671a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:33:59.939353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-53335f74-523b-41ef-bca1-92030613671a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.952540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53335f74-523b-41ef-bca1-92030613671a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:33:59.954351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53335f74-523b-41ef-bca1-92030613671a service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:33:59.955891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:33:59.957253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.966788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1168/2361] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:33:59.967633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:59.969201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:33:59.976845 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1194/2362] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:33:59.977748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335f74-523b-41ef-bca1-92030613671a service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:33:59.987252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647de1d-6473-46cc-8d3d-9c6a7ff11744 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:33:59.996028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:33:59.997333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:33:59.997750 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:33:59.998259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] PATH_INFO: `/v3/users/dc6a1e1f4df947b4b947371f151f5669` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.002880 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335f74-523b-41ef-bca1-92030613671a service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.010684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6a1e1f4df947b4b947371f151f5669)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.012406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.013419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.013927 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.017206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.017320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.017320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:00.017320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.017320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.045716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1195/2363] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:00.050138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.066347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223106cf-9013-4c9e-9efb-43b731fe3e54 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.076847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.077523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.077822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.078102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.078790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.081039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.221852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1196/2364] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:00 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:00.226876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.229205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6a1e1f4df947b4b947371f151f5669'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.250226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6a1e1f4df947b4b947371f151f5669'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.251097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6a1e1f4df947b4b947371f151f5669'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.251794 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6a1e1f4df947b4b947371f151f5669'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.298551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844a58-a888-45b0-b61d-998164356543 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.300797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.301477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.301766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.302055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.303332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.305422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.348485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6a1e1f4df947b4b947371f151f5669'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.370194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1169/2365] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:33:59 2022] DELETE /identity/v3/users/dc6a1e1f4df947b4b947371f151f5669 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:00.421640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1197/2366] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:00 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:00.429897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.433476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:00.501074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:00.525614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb383-57a8-4afb-8f73-50ec1469117c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.531882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.532598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.532944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.533411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.534025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.535628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.553073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1170/2367] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:00.554649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.566027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dadb4e-c28b-4b56-86eb-212ea8aee083 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.572002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.572726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.573093 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.573383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.574331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.576065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.587892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1198/2368] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:00.591970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.603917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f25d-b847-4fa1-a0d1-b9c39751571f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.609110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.610008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.610332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.610616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] PATH_INFO: `/v3/projects/99390a14988049c9a7a732831b310246/users/eda0bab901124f0cabb211fd9493d4e4/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.627326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99390a14988049c9a7a732831b310246, user_id=eda0bab901124f0cabb211fd9493d4e4, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.630034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133573e7-df7e-4819-b87d-9a9dda0ab68d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.658059 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.659801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:00.679858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2bb5-77ea-46e8-88ce-e0cc0f0a2bc5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.685825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.686207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.686285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.686524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] PATH_INFO: `/v3/projects/57e31a21bc7748b9b97988d455700753` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.687785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e31a21bc7748b9b97988d455700753)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.689826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.692366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:00.771885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1171/2369] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:00 2022] PUT /identity/v3/projects/99390a14988049c9a7a732831b310246/users/eda0bab901124f0cabb211fd9493d4e4/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:00.779022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.779318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.779605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.804295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e31a21bc7748b9b97988d455700753', 'request_id': 'req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.811527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] MFA Rules not processed for user `eda0bab901124f0cabb211fd9493d4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:00.812803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:00.879011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1172/2370] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:00.884339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:00.931016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e31a21bc7748b9b97988d455700753', 'request_id': 'req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.945565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e31a21bc7748b9b97988d455700753', 'request_id': 'req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.949830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ce7c-4e6b-46ed-9039-4b27d530ae04 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:00.954701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:00.955311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.955598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.955976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.956567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:00.958546 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:00.959815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] The token cache is being invalidate because project 57e31a21bc7748b9b97988d455700753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:00.960810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.961591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-02b0d39a-9ca5-4cfd-b8a6-eae4cac48a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:00.968579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1199/2371] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:00 2022] DELETE /identity/v3/projects/57e31a21bc7748b9b97988d455700753 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:00.970630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04dce6-4d30-4912-ab94-af1d4f6e5043 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:00.970992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04dce6-4d30-4912-ab94-af1d4f6e5043 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:00.971628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04dce6-4d30-4912-ab94-af1d4f6e5043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:00.991973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-be04dce6-4d30-4912-ab94-af1d4f6e5043 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:00.993227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-be04dce6-4d30-4912-ab94-af1d4f6e5043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.001474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1200/2372] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:01.010649 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.010991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.013083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.029676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:01.030891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.040143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1201/2373] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:01.044323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.054423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790d417-8e55-4200-b105-bbd19342d0d4 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.059120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.059843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.060121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.060399 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.061162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:01.061469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.063161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.076720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1202/2374] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:34:01.084383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.086241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1173/2375] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:00 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:01.090263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.092127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.094414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd207c-b86f-4fdf-89f7-eff414bb1cce admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.156428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.157719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.157719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.157914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.158630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.160586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.162869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b86671-5c09-4c4d-9450-02ac7a71dae3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.168410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.169129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.169415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.169699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.173434 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.175445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.294386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1174/2376] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:01.295609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.298047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:01.299029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1203/2377] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:01.299602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.300211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.362989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:01.374127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447c1d-b3ee-4d9d-a0a6-ce423de9de11 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.375450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7011d-8475-4dca-b80f-c339468cdfb7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.380242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.381138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.381533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.381819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.382658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.384284 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.394986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1204/2378] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:01.395808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.408030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461e4a-a5b3-49dc-a16d-1114f576449a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.413141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.413815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.414100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.414378 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.415124 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.419319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.434842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.435525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.435836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.436160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.438154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.455822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.457630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.472054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1175/2379] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:01.473897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.487462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd187-3abd-4bcf-9b4a-0b33213a9b9d service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.493542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.495262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.495766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.496246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] PATH_INFO: `/v3/projects/4111eedde6b14cb6858d8fcacb22a77a/users/dcd281cdeb3248e5978480a0c8fafa81/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.516974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4111eedde6b14cb6858d8fcacb22a77a, user_id=dcd281cdeb3248e5978480a0c8fafa81, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.520940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.527992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1205/2380] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:01.532191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.545551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690160-4a37-49ed-8652-3a27c4aaca6f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.553049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.554086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.555021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.555604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.557142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.560440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.574327 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1206/2381] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:01.578785 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.590660 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09101cc4-8a6b-4e0c-a82a-e33494f0a40d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.595893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.596458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.596787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.597054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.598025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.600110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.611388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1207/2382] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:01.616347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.628256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0042c-3ebb-4569-b70b-4a186bb5ebdc admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.636167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1176/2383] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:01 2022] PUT /identity/v3/projects/4111eedde6b14cb6858d8fcacb22a77a/users/dcd281cdeb3248e5978480a0c8fafa81/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:01.640428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.641647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.641937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.642222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] PATH_INFO: `/v3/projects/4ab6e2513d4e48d6b074e6fe4852f22a/users/c633f0d808cb4fb7ad47e1761406f878/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.642585 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.660122 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab6e2513d4e48d6b074e6fe4852f22a, user_id=c633f0d808cb4fb7ad47e1761406f878, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.663086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dbc2d-1c77-46a3-991a-a004781ab98b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.711827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0742-5aad-441c-a1a9-94b846dddbf5 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.717221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.717926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.718181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.718461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.719305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.720958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.734667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1177/2384] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:01.738367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.747724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:01.754525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137528-bf2d-4431-bf1d-f8b569451483 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:01.755115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1208/2385] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:01 2022] PUT /identity/v3/projects/4ab6e2513d4e48d6b074e6fe4852f22a/users/c633f0d808cb4fb7ad47e1761406f878/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:01.769960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.770402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.770688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.802461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] MFA Rules not processed for user `c633f0d808cb4fb7ad47e1761406f878`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:01.803809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.839557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:01.840937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.841381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.841811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] PATH_INFO: `/v3/projects/4111eedde6b14cb6858d8fcacb22a77a/users/dcd281cdeb3248e5978480a0c8fafa81/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.844182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4111eedde6b14cb6858d8fcacb22a77a, user_id=dcd281cdeb3248e5978480a0c8fafa81, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:01.850560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36f66-22b1-44d3-a253-97f0946a3f5c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:01.871549 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1178/2386] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:01 2022] PUT /identity/v3/projects/4111eedde6b14cb6858d8fcacb22a77a/users/dcd281cdeb3248e5978480a0c8fafa81/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:01.883381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:01.883745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:01.884129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:01.922020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] MFA Rules not processed for user `dcd281cdeb3248e5978480a0c8fafa81`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:01.923299 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:01.928470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1209/2387] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:01.936364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:01.938560 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:02.015981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1179/2388] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:02.028184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:02.029843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:02.055964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7d7c0-bd38-41a6-8db2-1b8b77b4b0b9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:02.143508 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c92df1-9912-447f-b3ff-f54e80e24cfa None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:02.144537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:02.145344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:02.145698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:02.146607 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:02.148664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:02.149337 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:02.149857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:02.150182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:02.169483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:02.170981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:02.182201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1180/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:02.214939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:02.216702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:02.218363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:02.228902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1210/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:02.273785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:02.292337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:02.294338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:02.298285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240c538-3f16-476b-a037-7972bc4b1115 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:02.308746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:02.309418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:02.309735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:02.310021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:02.315360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:02.348558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:02.381955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770359-3b67-4c64-b6dd-d80457f4f02c service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:02.387877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:02.388871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:02.389161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:02.389488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] PATH_INFO: `/v3/users/16d285f343f6452995b636d414e9ce80` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:02.393656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d285f343f6452995b636d414e9ce80)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:02.393852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:02.397837 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:02.399514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:02.410899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1181/2391] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:02.681587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d285f343f6452995b636d414e9ce80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:02.682496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d285f343f6452995b636d414e9ce80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:02.689676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d285f343f6452995b636d414e9ce80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:02.690344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d285f343f6452995b636d414e9ce80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:02.748272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:02.749636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a210f89b-b491-44e4-9d44-9a41bdb51500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d285f343f6452995b636d414e9ce80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:02.769407 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1211/2392] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:02 2022] DELETE /identity/v3/users/16d285f343f6452995b636d414e9ce80 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:03.120186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:03.158467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482100-5b12-43e4-aa51-1bcad3e65ca6 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:03.238736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:03.239613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:03.240694 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:03.240996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] PATH_INFO: `/v3/projects/5d4044e2798b43d6852064b0e529a580` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:03.242251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4044e2798b43d6852064b0e529a580)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:03.244185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:03.420258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4044e2798b43d6852064b0e529a580', 'request_id': 'req-3f7cf071-57b3-41cd-a059-37100f01eb4f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:03.426797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4044e2798b43d6852064b0e529a580', 'request_id': 'req-3f7cf071-57b3-41cd-a059-37100f01eb4f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:03.433274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4044e2798b43d6852064b0e529a580', 'request_id': 'req-3f7cf071-57b3-41cd-a059-37100f01eb4f'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:03.528487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] The token cache is being invalidate because project 5d4044e2798b43d6852064b0e529a580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:03.528744 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:03.531156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:03.531156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1182/2393] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:03 2022] DELETE /identity/v3/projects/5d4044e2798b43d6852064b0e529a580 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:04.748100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:04.748593 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:04.748710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:04.789440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] MFA Rules not processed for user `09cd0b66ae0145cb9e533335e23e2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:04.791588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:04.844178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1212/2394] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:05.160754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:05.162213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:05.196897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:05.227838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf071-57b3-41cd-a059-37100f01eb4f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:05.232297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:05.232985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:05.233273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:05.233553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:05.235333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:05.246685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:05.248138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039278dc-9749-44e9-97b5-44ee14c34515 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:05.257420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1183/2395] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:07.408117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:07.409589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:07.474843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717deb-c812-4f0e-9016-b81e1a7588bb None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:07.479254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:07.480132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:07.480423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:07.480734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] PATH_INFO: `/v3/users/eda0bab901124f0cabb211fd9493d4e4` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:07.482187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda0bab901124f0cabb211fd9493d4e4)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:07.484110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:07.636194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:07.641278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda0bab901124f0cabb211fd9493d4e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:07.642020 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda0bab901124f0cabb211fd9493d4e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:07.649139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda0bab901124f0cabb211fd9493d4e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:07.649783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda0bab901124f0cabb211fd9493d4e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:07.723977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda0bab901124f0cabb211fd9493d4e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:07.743688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1213/2396] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:07 2022] DELETE /identity/v3/users/eda0bab901124f0cabb211fd9493d4e4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:07.748478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:07.751818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:07.751818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:07.769432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:07.770627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:07.829373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1184/2397] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:07.839240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:07.840637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:07.900340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1856-0dcb-4ec2-a0ae-57f8254d5cdf admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:07.903924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:07.904578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:07.905004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:07.905302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:07.915200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:07.916665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:07.926070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1214/2398] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:08.348244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:08.350314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:08.363804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6bd07-110f-4446-9e3d-07d4963b11e8 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:08.368802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:08.373312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:08.373312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:08.373312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] PATH_INFO: `/v3/projects/99390a14988049c9a7a732831b310246` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:08.373312 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99390a14988049c9a7a732831b310246)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:08.373699 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:08.496165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99390a14988049c9a7a732831b310246', 'request_id': 'req-1f10a23e-bc6b-4350-9a4c-a0997d89b620'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.502705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99390a14988049c9a7a732831b310246', 'request_id': 'req-1f10a23e-bc6b-4350-9a4c-a0997d89b620'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.508809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99390a14988049c9a7a732831b310246', 'request_id': 'req-1f10a23e-bc6b-4350-9a4c-a0997d89b620'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.592175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] The token cache is being invalidate because project 99390a14988049c9a7a732831b310246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:08.592383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.593029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.594580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1185/2399] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:08 2022] DELETE /identity/v3/projects/99390a14988049c9a7a732831b310246 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:08.598569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:08.608931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734014a-cfa5-47e5-936c-ef0877dbdad0 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:08.665854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:08.666754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:08.667041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:08.667320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] PATH_INFO: `/v3/users/dcd281cdeb3248e5978480a0c8fafa81` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:08.668524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd281cdeb3248e5978480a0c8fafa81)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:08.670476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:08.832728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd281cdeb3248e5978480a0c8fafa81'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.833970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd281cdeb3248e5978480a0c8fafa81'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.840941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd281cdeb3248e5978480a0c8fafa81'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.841577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd281cdeb3248e5978480a0c8fafa81'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.910531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-6862fa7a-949a-47e0-8103-03e6caca8320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd281cdeb3248e5978480a0c8fafa81'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:08.911953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:08.929072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1215/2400] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:08 2022] DELETE /identity/v3/users/dcd281cdeb3248e5978480a0c8fafa81 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:09.388728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:09.390182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:09.407334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a23e-bc6b-4350-9a4c-a0997d89b620 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:09.456953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:09.466169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:09.467045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:09.470245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:09.470245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] PATH_INFO: `/v3/projects/4111eedde6b14cb6858d8fcacb22a77a` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:09.470245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4111eedde6b14cb6858d8fcacb22a77a)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:09.470724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:09.570455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4111eedde6b14cb6858d8fcacb22a77a', 'request_id': 'req-c96da1b3-877d-4542-aad8-476fb9787b33'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:09.577432 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4111eedde6b14cb6858d8fcacb22a77a', 'request_id': 'req-c96da1b3-877d-4542-aad8-476fb9787b33'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:09.582989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4111eedde6b14cb6858d8fcacb22a77a', 'request_id': 'req-c96da1b3-877d-4542-aad8-476fb9787b33'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:09.660623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] The token cache is being invalidate because project 4111eedde6b14cb6858d8fcacb22a77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:09.660928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:09.661564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c96da1b3-877d-4542-aad8-476fb9787b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:09.663113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1186/2401] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:09 2022] DELETE /identity/v3/projects/4111eedde6b14cb6858d8fcacb22a77a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:09.668115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:09.668587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:09.668726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:09.688461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:09.689725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:09.751320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1216/2402] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:09.762022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:09.762314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:09.762596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:09.781625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:09.782825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:09.793862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1187/2403] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:09.799839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:09.808175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e332fc1-bdbf-4c6f-8f55-25908c8f0ecd None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:09.812895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:09.813549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:09.813833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:09.814110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:09.814826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:09.815134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:09.816732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:09.828769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1217/2404] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:09.833181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:09.842606 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f16958-bca5-4cbf-b1ed-2e483ed89826 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:09.847768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:09.848486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:09.848800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:09.849159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:09.850042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:09.852413 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:09.977581 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1188/2405] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:09 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:09.981814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:09.993073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a1c68-ef51-4b55-a461-acf555862a1b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.057351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.058025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.058307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.058583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.059274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.061281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.199310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1218/2406] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:09 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:10.203518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.214135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca16a-f691-431a-9fcf-39501fb733a4 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.220122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.221043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.221402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.221770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.222601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.224934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.242685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1189/2407] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:10.246619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.257241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e283e3-8414-46ed-99dd-a96ee5824ab8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.261957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.265143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.265143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.265143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.265143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.265858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe557f1-090d-4bba-9d98-2195fd128947 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.277337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1219/2408] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:10.281530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.293917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be477c6-5757-48c3-9425-861b53e983d3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.297813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.298788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.299161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.299499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] PATH_INFO: `/v3/projects/6ed72576ddf14d74aa61112f2183c5f2/users/fd417c5002284ad8ac0378c89e8ff2d3/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.317573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed72576ddf14d74aa61112f2183c5f2, user_id=fd417c5002284ad8ac0378c89e8ff2d3, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.320446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.441067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1190/2409] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:10 2022] PUT /identity/v3/projects/6ed72576ddf14d74aa61112f2183c5f2/users/fd417c5002284ad8ac0378c89e8ff2d3/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:10.451542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.451970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.452268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.480573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] MFA Rules not processed for user `fd417c5002284ad8ac0378c89e8ff2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:10.482159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:10.515136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:10.545987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1220/2410] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:10.550463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.615561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff3ac6-02be-4982-ab76-8dd82a9999a7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.620424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.623153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.623153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.623153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.623153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.624289 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.702621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1191/2411] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:10 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:10.707004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.718243 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2ac9-a55a-4678-854c-c5c85ecb2fb3 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.780745 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.781357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.781640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.781921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.782733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.784721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.877664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1221/2412] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:10 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:10.881999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.888990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:10.892437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470229fd-24ab-436b-9370-29fedff2e3a3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.898154 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.898835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.899125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.899406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.900145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.901792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:10.912989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1192/2413] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:10.917268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:10.927668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319b35f-aba0-40d5-ba24-9922d92e273f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:10.932356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:10.933294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:10.933580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:10.933855 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] PATH_INFO: `/v3/projects/f9b32d21088b42efbb6bb5014f90ead1/users/7288c7c27f3a49a5b9183cf6e662fb08/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:10.949683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b32d21088b42efbb6bb5014f90ead1, user_id=7288c7c27f3a49a5b9183cf6e662fb08, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:10.952653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:11.061958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1222/2414] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:10 2022] PUT /identity/v3/projects/f9b32d21088b42efbb6bb5014f90ead1/users/7288c7c27f3a49a5b9183cf6e662fb08/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:11.066137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:11.076497 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e990a-93ef-42d4-85be-6927b19f37d2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:11.138912 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:11.139605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.140029 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.140317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.141184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:11.142795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae225-1b13-439c-bdaf-31fe1c404835 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:11.153984 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1193/2415] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:11.157967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:11.168476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f93e8-1840-4ab2-8ad3-49afc21b2936 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:11.174452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:11.175439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.175733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.176015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] PATH_INFO: `/v3/projects/f9b32d21088b42efbb6bb5014f90ead1/users/7288c7c27f3a49a5b9183cf6e662fb08/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.179940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b32d21088b42efbb6bb5014f90ead1, user_id=7288c7c27f3a49a5b9183cf6e662fb08, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:11.183425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:11.206653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.206953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.207243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.209096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1223/2416] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:11 2022] PUT /identity/v3/projects/f9b32d21088b42efbb6bb5014f90ead1/users/7288c7c27f3a49a5b9183cf6e662fb08/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:11.246594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] MFA Rules not processed for user `7288c7c27f3a49a5b9183cf6e662fb08`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:11.247825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:11.323339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1194/2417] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:11.336090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:11.340748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:11.399632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a6fd5-3f03-4f58-a8e7-c1614084ba7c admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:11.403875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:11.404717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.405008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.405647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.425860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:11.427512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b4cb6-b885-47f1-9d95-1544362f47d0 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:11.439611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1224/2418] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:11.530908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:11.598871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21379efb-c7dd-46c5-b4ec-d4809ba75b60 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:11.603657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:11.604575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.605052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.605361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] PATH_INFO: `/v3/users/fd417c5002284ad8ac0378c89e8ff2d3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.606807 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd417c5002284ad8ac0378c89e8ff2d3)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:11.608806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:11.627431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:11.835209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd417c5002284ad8ac0378c89e8ff2d3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:11.848451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd417c5002284ad8ac0378c89e8ff2d3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:11.850046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd417c5002284ad8ac0378c89e8ff2d3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:11.851355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd417c5002284ad8ac0378c89e8ff2d3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:11.913668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd417c5002284ad8ac0378c89e8ff2d3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:11.928476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1195/2419] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:11 2022] DELETE /identity/v3/users/fd417c5002284ad8ac0378c89e8ff2d3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:11.933368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:11.933866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:11.933973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:11.953111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:11.954380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:11.981187 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:12.016559 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1225/2420] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:12.031350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:12.034380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:12.091450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f3df-3d90-4b96-8fec-b0010ad8816d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:12.094982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:12.095629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:12.095919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:12.096206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:12.106020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:12.107520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:12.118004 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1196/2421] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:12.849261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:12.852531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:12.865604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb69a9-54ee-43ee-9eea-410b1ef18708 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:12.870581 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:12.871483 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:12.871777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:12.872062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] PATH_INFO: `/v3/projects/6ed72576ddf14d74aa61112f2183c5f2` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:12.873646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed72576ddf14d74aa61112f2183c5f2)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:12.875527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:13.023628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed72576ddf14d74aa61112f2183c5f2', 'request_id': 'req-0cedb626-2811-47a6-8d08-941b82ad3ac8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.124129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed72576ddf14d74aa61112f2183c5f2', 'request_id': 'req-0cedb626-2811-47a6-8d08-941b82ad3ac8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.131208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed72576ddf14d74aa61112f2183c5f2', 'request_id': 'req-0cedb626-2811-47a6-8d08-941b82ad3ac8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.142853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] The token cache is being invalidate because project 6ed72576ddf14d74aa61112f2183c5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:13.143174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.143843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.145459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1226/2422] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:12 2022] DELETE /identity/v3/projects/6ed72576ddf14d74aa61112f2183c5f2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:13.149578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:13.159288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cce5-4e89-403a-b5bb-0ce959af1115 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:13.219226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:13.221596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:13.221885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:13.222168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] PATH_INFO: `/v3/users/7288c7c27f3a49a5b9183cf6e662fb08` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:13.223406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] RBAC: Authorizing `identity:delete_user(user_id=7288c7c27f3a49a5b9183cf6e662fb08)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:13.226027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:13.416288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:13.422058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7288c7c27f3a49a5b9183cf6e662fb08'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.434158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7288c7c27f3a49a5b9183cf6e662fb08'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.434854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7288c7c27f3a49a5b9183cf6e662fb08'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.435504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7288c7c27f3a49a5b9183cf6e662fb08'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.524208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7288c7c27f3a49a5b9183cf6e662fb08'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:13.537464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1197/2423] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:13 2022] DELETE /identity/v3/users/7288c7c27f3a49a5b9183cf6e662fb08 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:13.994186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:13.994622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.008040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedb626-2811-47a6-8d08-941b82ad3ac8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.032061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.033536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.079191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.080191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.080484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.080813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] PATH_INFO: `/v3/users/c633f0d808cb4fb7ad47e1761406f878` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.082033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c633f0d808cb4fb7ad47e1761406f878)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.084883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.108064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab98b4c-b3e7-43d3-88aa-9c0195048add admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.113011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.117529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.117529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.117529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] PATH_INFO: `/v3/projects/f9b32d21088b42efbb6bb5014f90ead1` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.117529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b32d21088b42efbb6bb5014f90ead1)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.118327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.246408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c633f0d808cb4fb7ad47e1761406f878'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.247099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c633f0d808cb4fb7ad47e1761406f878'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.251868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b32d21088b42efbb6bb5014f90ead1', 'request_id': 'req-5628da4d-a36e-4e84-acbd-094a5fdb56fe'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.254343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c633f0d808cb4fb7ad47e1761406f878'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.255067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c633f0d808cb4fb7ad47e1761406f878'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.257383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:14.259633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b32d21088b42efbb6bb5014f90ead1', 'request_id': 'req-5628da4d-a36e-4e84-acbd-094a5fdb56fe'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.267143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b32d21088b42efbb6bb5014f90ead1', 'request_id': 'req-5628da4d-a36e-4e84-acbd-094a5fdb56fe'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.310206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f9ea5d01-2a9b-4323-9d08-b223b2d090e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c633f0d808cb4fb7ad47e1761406f878'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.328372 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1227/2424] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:13 2022] DELETE /identity/v3/users/c633f0d808cb4fb7ad47e1761406f878 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:14.333008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.333507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.334048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.358267 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:14.359465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.373241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] The token cache is being invalidate because project f9b32d21088b42efbb6bb5014f90ead1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:14.373592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.374403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5628da4d-a36e-4e84-acbd-094a5fdb56fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:14.375920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1198/2425] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:14 2022] DELETE /identity/v3/projects/f9b32d21088b42efbb6bb5014f90ead1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:14.380793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c8e7-7ea0-4d81-bcb1-bfad2b37e99b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.381777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c8e7-7ea0-4d81-bcb1-bfad2b37e99b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.382203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c8e7-7ea0-4d81-bcb1-bfad2b37e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.401231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4339c8e7-7ea0-4d81-bcb1-bfad2b37e99b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:14.402521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4339c8e7-7ea0-4d81-bcb1-bfad2b37e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.421715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1228/2426] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:14.441502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.442990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.449960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:14.467368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1199/2427] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:14.474840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.475187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.475503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.494229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:14.495401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.503873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4400-626a-451b-8d2b-5d8d4d020091 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.504358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1200/2428] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:14.508021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.508427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.512395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.512395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.512395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.517722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9c7b-2dc2-460b-8c38-258c16224cb9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.519571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.521042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.522791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.523474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.523758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.524036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.524786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:14.525097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.526674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.531438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1229/2429] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:14.539686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1201/2430] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:34:14.543926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.554679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bec9-c853-46df-a367-cc5e986cc59c service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.559733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.560394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.560714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.560998 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.561752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.563688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.646775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1230/2431] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:14.653009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.658295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7eae6-f893-4e53-a73a-12dc2eb90428 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.715939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.716672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.716958 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.717232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.717911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.722587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.782284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1202/2432] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:14.786416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.797395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef542d-a639-48b1-9555-eca803a8c5ee admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.802115 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.803741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.804081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.804367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.805188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.806791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.819508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1231/2433] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:14.832112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.842780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43c5-dfdb-4770-a463-bed4337ffc55 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.847528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.848192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.848578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.848871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.850099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.851709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.862504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1203/2434] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:14.866881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.877079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1862-07db-4507-ab4d-c9acfb9f02b9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.882333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.883210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.883499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.883783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] PATH_INFO: `/v3/projects/d5a65a9d262543578e7b0ec720d943e5/users/86e35951208c40b9a9988857113ee5c8/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.899281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a65a9d262543578e7b0ec720d943e5, user_id=86e35951208c40b9a9988857113ee5c8, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.902035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b141fa-4742-48c1-84fa-3d6dde321524 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.920374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:14.922127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:14.938425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199319-8968-4647-9a3f-5a608c6bc7f8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:14.949399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:14.949614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:14.949831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:14.951250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] PATH_INFO: `/v3/projects/4ab6e2513d4e48d6b074e6fe4852f22a` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:14.952600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab6e2513d4e48d6b074e6fe4852f22a)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:14.954590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:14.989823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1232/2435] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:14 2022] PUT /identity/v3/projects/d5a65a9d262543578e7b0ec720d943e5/users/86e35951208c40b9a9988857113ee5c8/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:15.000546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.000911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.001200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.030135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] MFA Rules not processed for user `86e35951208c40b9a9988857113ee5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:15.031467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:15.041349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:15.094192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab6e2513d4e48d6b074e6fe4852f22a', 'request_id': 'req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:15.104165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab6e2513d4e48d6b074e6fe4852f22a', 'request_id': 'req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:15.106516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1233/2436] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:15.111194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.112228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab6e2513d4e48d6b074e6fe4852f22a', 'request_id': 'req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:15.174313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810fa7d-4508-4e92-a90d-c4359d507ce5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.226975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] The token cache is being invalidate because project 4ab6e2513d4e48d6b074e6fe4852f22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:15.227272 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:15.227948 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1a1a85b8-a6f3-4cac-b7b2-2fe2a83ba824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:15.229559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1204/2437] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:14 2022] DELETE /identity/v3/projects/4ab6e2513d4e48d6b074e6fe4852f22a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:15.233536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.233536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.233774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.234056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.235245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.235364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac05d-bf84-48a6-a415-22715d814154 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.235786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac05d-bf84-48a6-a415-22715d814154 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.236165 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac05d-bf84-48a6-a415-22715d814154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.237334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.258071 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9f7ac05d-bf84-48a6-a415-22715d814154 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:15.259295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9f7ac05d-bf84-48a6-a415-22715d814154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:15.267796 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1205/2438] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:15.276541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.276875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.277156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.300285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:15.301544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:15.311681 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1206/2439] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:15.316981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.326981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58c2b-e4ea-46bd-9e3c-ee9fe527f18f None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.329947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1234/2440] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:15.335443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.337561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:15.340598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:15.389098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:15.390706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.391475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.391830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.392185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.393275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:15.393765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.395368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.409422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e626-9df3-4987-8cc3-5a1a0d2b9e51 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.414961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1207/2441] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:15.415758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.416372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.416639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.417000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.417482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.418261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.420395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.426901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed0e1d-489b-4412-8c7a-a217ab1ca026 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.431727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.432469 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.432792 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.433078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.433923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.435846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.530779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1235/2442] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:15.534748 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.546339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1330-e25f-49a5-b08c-25d7a20354c1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.548894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1208/2443] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:15.552999 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.553545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.553655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.554068 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.554729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.555486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.557295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.567753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1236/2444] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:15.573356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.583661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723d93-8a90-4be7-b2a7-d8d90d171cf3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.637474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211ffb-c167-46d6-94ca-b2d7fe2aff0e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.646270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.648110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.648784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.649305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.651008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.653734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.659364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.660567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.661049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.661469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] PATH_INFO: `/v3/projects/293e5fcbba4f41b495f9c171c26245a9/users/de4c5c7252a94d3ab011c34f924842af/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.685767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=293e5fcbba4f41b495f9c171c26245a9, user_id=de4c5c7252a94d3ab011c34f924842af, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.690175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.781668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1209/2445] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:15.785985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.796036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22b82-5560-4cb6-ac63-7874df6d67f8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.800802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.801536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.801893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.802182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.803777 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.805066 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.810939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1237/2446] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:15 2022] PUT /identity/v3/projects/293e5fcbba4f41b495f9c171c26245a9/users/de4c5c7252a94d3ab011c34f924842af/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:15.814921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.816736 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1210/2447] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:15.822052 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.833220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077c312-785e-4ffc-b328-548a761b7e03 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.881700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee47e-af6c-4b61-bb9c-5825ca7f5d0e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.886936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.887771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.888067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.888350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.889134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.890766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.900118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.900838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.901129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.901406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.902135 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.905374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1238/2448] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:15.905512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.906405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.914534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1211/2449] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:15.917566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce862f-cdaa-4d2e-84ec-b4d5c89109d7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.921574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:15.925299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.926401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.926691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.926969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] PATH_INFO: `/v3/projects/293e5fcbba4f41b495f9c171c26245a9/users/de4c5c7252a94d3ab011c34f924842af/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.927234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:15.929600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] RBAC: Authorizing `identity:create_grant(project_id=293e5fcbba4f41b495f9c171c26245a9, user_id=de4c5c7252a94d3ab011c34f924842af, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.932278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43513a4a-e341-4c67-b17e-6e53933c574b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.934555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aff3ce-fbeb-4dfa-ade4-069c14922a7b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:15.939026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:15.941367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.941367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.941367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] PATH_INFO: `/v3/projects/6cb6ad9644df48b0a0713c245e32803d/users/4e75ca798cc24bc1aff76aebb0cf036c/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.944640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1239/2450] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:15 2022] PUT /identity/v3/projects/293e5fcbba4f41b495f9c171c26245a9/users/de4c5c7252a94d3ab011c34f924842af/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:15.955920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:15.956237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:15.956492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:15.957583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb6ad9644df48b0a0713c245e32803d, user_id=4e75ca798cc24bc1aff76aebb0cf036c, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:15.961072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47700c3-cb10-4a59-b57c-1830d16ca2f5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:15.991683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] MFA Rules not processed for user `de4c5c7252a94d3ab011c34f924842af`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:15.993002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:16.014457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:16.038975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1212/2451] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:15 2022] PUT /identity/v3/projects/6cb6ad9644df48b0a0713c245e32803d/users/4e75ca798cc24bc1aff76aebb0cf036c/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:16.050726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.051015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.051300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.079770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] MFA Rules not processed for user `4e75ca798cc24bc1aff76aebb0cf036c`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:16.081036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:16.090744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1240/2452] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:16.098420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.100497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:16.165601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bcba6-a647-4110-898d-84dc99ca6e9f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.171386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1213/2453] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:16.176109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.243144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.244186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.244186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.244367 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.269466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ad10-15f2-48de-9ba8-073007ff2e79 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.275030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.275714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.276522 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.276858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.277563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.280020 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.329950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.331522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.343047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1241/2454] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:16.366451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1214/2455] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:16 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:16.372631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.384297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40a0f-6444-42d3-98fe-370a90f38c3f service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.442865 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.444278 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.444450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.444761 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.445462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.447474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.460090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:16.564974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1242/2456] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:16 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:16.571431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.577868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cffe03-0d0a-4dc0-91e0-2c6d976b5afa admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.582567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.583239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.583567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.584036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.585037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.586646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.601155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1215/2457] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:16.603793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.614066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74308017-785e-4d27-b57e-a63c142fb891 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.619538 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.620425 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.620756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.621029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] PATH_INFO: `/v3/projects/285ae8a781434b568d6d15863f60842a/users/878a4ec84c064d5880153766889e8aa1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.636676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285ae8a781434b568d6d15863f60842a, user_id=878a4ec84c064d5880153766889e8aa1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.639348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.746599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1243/2458] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:16 2022] PUT /identity/v3/projects/285ae8a781434b568d6d15863f60842a/users/878a4ec84c064d5880153766889e8aa1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:16.755006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.774735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630bf17-bd02-4e9c-88e7-7616a82f05b5 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.815425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:16.834729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.835480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.835696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.835979 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.836755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.838365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4209aed-4ceb-4ec2-9606-5f72bdc38145 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.848516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1216/2459] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:16.856801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:16.865041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0836371-efa6-4d16-b082-739bb755f249 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:16.870343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:16.871236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.871523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.871803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] PATH_INFO: `/v3/projects/285ae8a781434b568d6d15863f60842a/users/878a4ec84c064d5880153766889e8aa1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.873811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=285ae8a781434b568d6d15863f60842a, user_id=878a4ec84c064d5880153766889e8aa1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:16.876553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:16.888544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1244/2460] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:16 2022] PUT /identity/v3/projects/285ae8a781434b568d6d15863f60842a/users/878a4ec84c064d5880153766889e8aa1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:16.898932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:16.899232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:16.899523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:16.926353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] MFA Rules not processed for user `878a4ec84c064d5880153766889e8aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:16.928218 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:17.001990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1217/2461] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:17.014570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:17.075608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ca794-843d-4419-82f1-ebac2d2d072a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:17.083543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:17.084254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:17.084548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:17.084906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:17.094601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:17.096047 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1339838-329a-4ee9-b23c-055ef1ee7f28 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:17.106722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1245/2462] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:17.367501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:17.442168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8fede-47c0-45d0-9376-5cad0b254feb None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:17.449106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:17.450022 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:17.450308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:17.450586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] PATH_INFO: `/v3/users/86e35951208c40b9a9988857113ee5c8` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:17.451901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e35951208c40b9a9988857113ee5c8)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:17.453875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:17.693392 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e35951208c40b9a9988857113ee5c8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:17.707065 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e35951208c40b9a9988857113ee5c8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:17.707855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e35951208c40b9a9988857113ee5c8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:17.708870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e35951208c40b9a9988857113ee5c8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:17.713282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:17.781351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e35951208c40b9a9988857113ee5c8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:17.795244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1218/2463] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:17 2022] DELETE /identity/v3/users/86e35951208c40b9a9988857113ee5c8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:17.799759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:17.800282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:17.800500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:17.819577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:17.820820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:17.883247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1246/2464] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:17.893394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:17.894830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:17.954214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f64ea-be55-4d19-b24a-11e0d2e360ec admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:17.957892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:17.958537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:17.958868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:17.959499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:17.969006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:17.970467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:17.982344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1219/2465] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:18.109614 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.111012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:18.126385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:18.179663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b1d0-7c32-4d71-b907-282164f72f2a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.184138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878a4ec84c064d5880153766889e8aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '285ae8a781434b568d6d15863f60842a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.184819 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.185109 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.189867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.189867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:18.189867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.189867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:18.200052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1247/2466] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:18.204245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.215059 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0ac95-d696-449d-952e-01b276916e13 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.221919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878a4ec84c064d5880153766889e8aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '285ae8a781434b568d6d15863f60842a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.222621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.222915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.223191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.223891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.226258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:18.312894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1220/2467] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:18 2022] POST /identity/v3/projects => generated 354 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:18.316795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.328166 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a047-937b-4cac-afba-b3c3d3619e84 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.409149 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878a4ec84c064d5880153766889e8aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '285ae8a781434b568d6d15863f60842a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.410061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.410492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.410922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.412092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:18.412571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.415167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:18.432710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1248/2468] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:18.470175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.480489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.482139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1cdbe-0386-45b4-915d-2f39e1b74ca0 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.482611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:18.487804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878a4ec84c064d5880153766889e8aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '285ae8a781434b568d6d15863f60842a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.489280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.490233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.490593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] PATH_INFO: `/v3/projects/da19782c1ec84fed91483e9f5a5a9c21` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.492647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da19782c1ec84fed91483e9f5a5a9c21)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.494982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:18.553711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907afe4-ebeb-4eb8-b199-5603bcd1ad29 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.558627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.559575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.559931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.560220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] PATH_INFO: `/v3/projects/d5a65a9d262543578e7b0ec720d943e5` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.561440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a65a9d262543578e7b0ec720d943e5)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.563370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:18.611317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da19782c1ec84fed91483e9f5a5a9c21', 'request_id': 'req-0800a66a-be88-4af9-a663-c597a5422ac8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.618359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da19782c1ec84fed91483e9f5a5a9c21', 'request_id': 'req-0800a66a-be88-4af9-a663-c597a5422ac8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.624426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da19782c1ec84fed91483e9f5a5a9c21', 'request_id': 'req-0800a66a-be88-4af9-a663-c597a5422ac8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.664151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:18.668316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a65a9d262543578e7b0ec720d943e5', 'request_id': 'req-f21440c7-5b0c-4d21-a78a-808150ee48c2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.746868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] The token cache is being invalidate because project da19782c1ec84fed91483e9f5a5a9c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:18.747179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.747823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.749438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1221/2469] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:18 2022] DELETE /identity/v3/projects/da19782c1ec84fed91483e9f5a5a9c21 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:18.832497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a65a9d262543578e7b0ec720d943e5', 'request_id': 'req-f21440c7-5b0c-4d21-a78a-808150ee48c2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.840011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a65a9d262543578e7b0ec720d943e5', 'request_id': 'req-f21440c7-5b0c-4d21-a78a-808150ee48c2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.852250 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] The token cache is being invalidate because project d5a65a9d262543578e7b0ec720d943e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:18.852549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.853261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:18.854930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1249/2470] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:18 2022] DELETE /identity/v3/projects/d5a65a9d262543578e7b0ec720d943e5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:18.859199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:18.860621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:18.910790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:18.928544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a66a-be88-4af9-a663-c597a5422ac8 tempest-VolumeQuotaClassesTest-1235614814 tempest-VolumeQuotaClassesTest-1235614814-project-admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:18.985124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:18.986048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:18.986354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:18.986639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] PATH_INFO: `/v3/users/de4c5c7252a94d3ab011c34f924842af` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:18.987901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4c5c7252a94d3ab011c34f924842af)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:18.989900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:19.210409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4c5c7252a94d3ab011c34f924842af'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.223324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4c5c7252a94d3ab011c34f924842af'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.224032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4c5c7252a94d3ab011c34f924842af'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.224829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4c5c7252a94d3ab011c34f924842af'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.338831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4c5c7252a94d3ab011c34f924842af'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.351989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1222/2471] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:18 2022] DELETE /identity/v3/users/de4c5c7252a94d3ab011c34f924842af => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:19.422437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:19.424080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:19.439973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440c7-5b0c-4d21-a78a-808150ee48c2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:19.495471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:19.496339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:19.496650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:19.496935 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] PATH_INFO: `/v3/users/4e75ca798cc24bc1aff76aebb0cf036c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:19.498235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e75ca798cc24bc1aff76aebb0cf036c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:19.500179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:19.715795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e75ca798cc24bc1aff76aebb0cf036c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.716595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e75ca798cc24bc1aff76aebb0cf036c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.727377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e75ca798cc24bc1aff76aebb0cf036c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.728142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e75ca798cc24bc1aff76aebb0cf036c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.805383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c2466d39-60e3-4c7f-b86f-49abc3c4f330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e75ca798cc24bc1aff76aebb0cf036c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:19.813518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:19.814973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:19.828915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e1d8-11dc-4d1a-875d-9874129217b7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:19.829810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1250/2472] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:19 2022] DELETE /identity/v3/users/4e75ca798cc24bc1aff76aebb0cf036c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:19.835622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:19.837009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:19.837255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:19.859554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:19.860836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:19.921196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:19.935101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:19.936039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:19.936384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:19.936753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] PATH_INFO: `/v3/projects/293e5fcbba4f41b495f9c171c26245a9` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:19.937514 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1251/2473] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:19.938336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293e5fcbba4f41b495f9c171c26245a9)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:19.940263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:19.947682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:19.949196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:19.957570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:20.010119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1d82-aaaf-4992-a87d-f1a46608ad26 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.015000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.015741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.016029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.017631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.027633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.029110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96da53-8466-45bc-a48e-5c33425307c1 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.039294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1252/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:20.086383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293e5fcbba4f41b495f9c171c26245a9', 'request_id': 'req-83b49213-c9d5-47be-b852-0b021cc6d388'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.092643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293e5fcbba4f41b495f9c171c26245a9', 'request_id': 'req-83b49213-c9d5-47be-b852-0b021cc6d388'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.098109 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293e5fcbba4f41b495f9c171c26245a9', 'request_id': 'req-83b49213-c9d5-47be-b852-0b021cc6d388'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.207594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] The token cache is being invalidate because project 293e5fcbba4f41b495f9c171c26245a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:20.207886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.208521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-83b49213-c9d5-47be-b852-0b021cc6d388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.210819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1223/2475] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:19 2022] DELETE /identity/v3/projects/293e5fcbba4f41b495f9c171c26245a9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:20.215909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.216214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.216501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.237343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:20.238568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:20.308645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1253/2476] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:20.316553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.319906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.319906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.338144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:20.339383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:20.347556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1224/2477] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:20.352837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.363138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbea440-1f2b-4e59-a770-dc17ba16d5e9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.368574 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.369285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.369575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.369856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.370599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:20.370907 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.372590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.385458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1254/2478] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:20.389987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.400623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e026473-a6a8-4fcc-bfa2-d6283b51b52c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.405383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.406142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.406427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.406709 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.407423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.409412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.490321 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1225/2479] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:20 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:20.495630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.508442 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d090-378c-4217-b564-e9a6bcbb1641 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.566858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.567453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.567739 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.568016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.569535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.571488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.677044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1255/2480] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:20 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:20.681855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.692281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695d95-f8d5-4246-be90-952a9097a844 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.697793 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.698487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.698772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.699108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.699766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.701426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.704417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.706281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:20.712679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1226/2481] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:20.716554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.723224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e9c8-3a07-42af-94db-d4eeb3f91863 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.728683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.729561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.729849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.729961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed5be-8ca4-4c76-8f0b-b4faf1cb7be1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.730132 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] PATH_INFO: `/v3/projects/6cb6ad9644df48b0a0713c245e32803d` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.731571 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb6ad9644df48b0a0713c245e32803d)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.733639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.736387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.737161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.737407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.737867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.738588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.741111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.741446 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:20.752248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1227/2482] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:20.756161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:20.766160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4ed5-b031-4e4c-94e1-acbbe357f50c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:20.770882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:20.772105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.776860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.776860 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] PATH_INFO: `/v3/projects/8531a89dc6c64baa87680f37c71421f0/users/ef15d2e97e6247cf960a26cda7f38732/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.788746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8531a89dc6c64baa87680f37c71421f0, user_id=ef15d2e97e6247cf960a26cda7f38732, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:20.791454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1139f8-6142-426d-9e75-52d13d43738d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:20.918435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1228/2483] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:20 2022] PUT /identity/v3/projects/8531a89dc6c64baa87680f37c71421f0/users/ef15d2e97e6247cf960a26cda7f38732/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:20.927201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb6ad9644df48b0a0713c245e32803d', 'request_id': 'req-91c19531-cf64-40f7-9d75-498c000c4b44'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:20.929799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:20.930170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:20.930537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:20.962357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] MFA Rules not processed for user `ef15d2e97e6247cf960a26cda7f38732`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:20.963831 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.026106 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb6ad9644df48b0a0713c245e32803d', 'request_id': 'req-91c19531-cf64-40f7-9d75-498c000c4b44'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.034865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1229/2484] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:21.036003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb6ad9644df48b0a0713c245e32803d', 'request_id': 'req-91c19531-cf64-40f7-9d75-498c000c4b44'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.046759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:21.048231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.048664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] The token cache is being invalidate because project 6cb6ad9644df48b0a0713c245e32803d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:21.049012 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.049709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.051594 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1256/2485] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:20 2022] DELETE /identity/v3/projects/6cb6ad9644df48b0a0713c245e32803d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:21.055984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:21.057369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.071056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:21.117674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f4590-a169-457f-bc6e-acc55d9d1535 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:21.121620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:21.122278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:21.123646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:21.123646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:21.125331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.129891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19531-cf64-40f7-9d75-498c000c4b44 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:21.136424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:21.137463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:21.143621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:21.143621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] PATH_INFO: `/v3/users/878a4ec84c064d5880153766889e8aa1` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:21.143819 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:21.143940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=878a4ec84c064d5880153766889e8aa1)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:21.144032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:21.144131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:21.154412 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1230/2486] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:21.174924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:21.176411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.191832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452d4a7-b29c-4bef-bbac-c6f114575571 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:21.196192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:21.197108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:21.197395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:21.197673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] PATH_INFO: `/v3/users/ef15d2e97e6247cf960a26cda7f38732` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:21.198895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef15d2e97e6247cf960a26cda7f38732)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:21.200916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:21.390708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878a4ec84c064d5880153766889e8aa1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.391513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878a4ec84c064d5880153766889e8aa1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.400464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878a4ec84c064d5880153766889e8aa1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.401222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878a4ec84c064d5880153766889e8aa1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.403439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef15d2e97e6247cf960a26cda7f38732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.416028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef15d2e97e6247cf960a26cda7f38732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.416772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef15d2e97e6247cf960a26cda7f38732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.417409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef15d2e97e6247cf960a26cda7f38732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.490014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a7eca85b-65b5-40d9-8c5a-137d317ba9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878a4ec84c064d5880153766889e8aa1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.509774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1257/2487] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:21 2022] DELETE /identity/v3/users/878a4ec84c064d5880153766889e8aa1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:21.552960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef15d2e97e6247cf960a26cda7f38732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:21.569054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1231/2488] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:21 2022] DELETE /identity/v3/users/ef15d2e97e6247cf960a26cda7f38732 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:21.574076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:21.574510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:21.574904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:21.593461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:21.594848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.605519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:21.664168 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1258/2489] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:21.675551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:21.679231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:21.749208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038933-9587-4e3c-a406-a788f8d4d6c8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:21.753933 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:21.754880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:21.755241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:21.755573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:21.768745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:21.770377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:21.787258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1232/2490] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:22.117254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.119114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.133638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f4b66-4a0f-4b74-bd1f-cb478c67749e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.139691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.140910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.141390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.141733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] PATH_INFO: `/v3/projects/285ae8a781434b568d6d15863f60842a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.143613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=285ae8a781434b568d6d15863f60842a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.157066 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.271388 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.272096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285ae8a781434b568d6d15863f60842a', 'request_id': 'req-ec80921c-f67e-4379-be20-382fda5d1efb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.272867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.316360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:22.346162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285ae8a781434b568d6d15863f60842a', 'request_id': 'req-ec80921c-f67e-4379-be20-382fda5d1efb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.354333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285ae8a781434b568d6d15863f60842a', 'request_id': 'req-ec80921c-f67e-4379-be20-382fda5d1efb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.357465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54ddad-6919-4478-b659-47d5e080d448 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.374336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] The token cache is being invalidate because project 285ae8a781434b568d6d15863f60842a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:22.375098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.376390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.379222 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1259/2491] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:22 2022] DELETE /identity/v3/projects/285ae8a781434b568d6d15863f60842a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:22.380193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.382524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.457256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.458917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.459411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.459783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.462015 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.465617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80921c-f67e-4379-be20-382fda5d1efb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.471236 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.472136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.472458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.472772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] PATH_INFO: `/v3/projects/8531a89dc6c64baa87680f37c71421f0` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.474411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8531a89dc6c64baa87680f37c71421f0)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.476556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.476732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.478423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa898f2-4d3d-4405-bcf8-46163643ba19 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.491382 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1233/2492] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:22.492903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98068f34-98bb-411c-b7b6-432ef7188f38 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.493263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98068f34-98bb-411c-b7b6-432ef7188f38 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.493603 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98068f34-98bb-411c-b7b6-432ef7188f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.515198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-98068f34-98bb-411c-b7b6-432ef7188f38 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:22.517305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-98068f34-98bb-411c-b7b6-432ef7188f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.533696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1234/2493] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:22.535054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.535357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.535645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.555509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:22.556765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.565605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1235/2494] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:22.569826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.579926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f2451-7152-49ef-aeff-2e6bf6a0c30d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.585909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.586611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.586898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.587179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.587986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:22.588303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.589989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.606817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1236/2495] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:34:22.609311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.619615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:22.620275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7999a-8349-4a71-8ad1-25fcbeefaf75 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.629822 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8531a89dc6c64baa87680f37c71421f0', 'request_id': 'req-a9cdd065-8a74-4e41-a05a-299f56db5949'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.694144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.694962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.695254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.695532 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.696233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.698186 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.707103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8531a89dc6c64baa87680f37c71421f0', 'request_id': 'req-a9cdd065-8a74-4e41-a05a-299f56db5949'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.718533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8531a89dc6c64baa87680f37c71421f0', 'request_id': 'req-a9cdd065-8a74-4e41-a05a-299f56db5949'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.733283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] The token cache is being invalidate because project 8531a89dc6c64baa87680f37c71421f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:22.734270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.734643 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-a9cdd065-8a74-4e41-a05a-299f56db5949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:22.736582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1260/2496] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:22 2022] DELETE /identity/v3/projects/8531a89dc6c64baa87680f37c71421f0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:22.743135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bb00-5130-413d-ace3-84fbc14b5dda None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.743549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bb00-5130-413d-ace3-84fbc14b5dda None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.744087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bb00-5130-413d-ace3-84fbc14b5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.773678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-30f3bb00-5130-413d-ace3-84fbc14b5dda None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:22.775199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-30f3bb00-5130-413d-ace3-84fbc14b5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.792793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1261/2497] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:22.795904 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.796298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.796674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.817669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:22.819160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.830631 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1262/2498] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:22.831782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.841258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26d4b-9aed-4182-8b18-ca845cd8f36a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.847684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.848369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.848751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.849046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.851159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:22.857234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.857234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.859828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1237/2499] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:22.863982 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.867651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:22.874062 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1263/2500] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:22.876920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:22.889274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd8783-91cf-4664-a7fa-bf9dd0d08a44 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.896203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:22.954719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ce89-4bf2-42cd-a970-4a18cecfdf06 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:22.962271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.962997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.963294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.963628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.964282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.965131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:22.966002 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:22.966281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:22.966768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:22.967226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:22.968098 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:22.970304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.072200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1238/2501] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:23.075972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.096834 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4959ef4-0da3-4ceb-ba78-9e894b8eea4b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.104919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.106064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.106360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.106743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.107827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.109629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1264/2502] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:22 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:23.109784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.115333 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.128644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1239/2503] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:23.133268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.149090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20590e-c6cc-4009-b0fe-61461557e057 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.222856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c39e0-6929-4ab7-941a-553f7e6ad8bd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.228502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.229321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.229707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.230110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.232239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.236403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.237415 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.239041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.239341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.239629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.241621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.243341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.259130 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1240/2504] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:23.259997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.270586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca33e-30e5-4f08-9a67-85693939138e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.275688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.276578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.276903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.277182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] PATH_INFO: `/v3/projects/78aacddcc78f4e98af435debc7444ff3/users/838fac6712b24c3985becd86ead049b8/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.292381 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aacddcc78f4e98af435debc7444ff3, user_id=838fac6712b24c3985becd86ead049b8, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.295378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c14fb4-8055-4f92-afde-e434dfeb4040 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.347338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1265/2505] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:23 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:23.351558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.362270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6200a-2313-4e70-92a7-f4b9675ddc72 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.367767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.368521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.368928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.369285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.370030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.371731 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.383573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1266/2506] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:34:23.389644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.397054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:23.401854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ba05-654b-4c41-ada5-40083784119a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.407380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1241/2507] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:23 2022] PUT /identity/v3/projects/78aacddcc78f4e98af435debc7444ff3/users/838fac6712b24c3985becd86ead049b8/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:23.468046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.468782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.468895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.469065 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.469160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.469356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.469475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.470141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.471912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.486979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1267/2508] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:23.492178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.504711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d842-b537-42c6-9d7c-9ed0b71d608b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.510310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] MFA Rules not processed for user `838fac6712b24c3985becd86ead049b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:23.511779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:23.511896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.513102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.513598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.514448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] PATH_INFO: `/v3/projects/491bae5f8bf44db2b25a204d662f6914/users/1d4bfe02981c429b8633e4e02efebc1b/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.539381 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=491bae5f8bf44db2b25a204d662f6914, user_id=1d4bfe02981c429b8633e4e02efebc1b, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.542354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572acd-1852-4bd5-886b-01329526c69c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.582939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:23.588672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1242/2509] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:23.593350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.604543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ca35-420d-4b0f-8b2c-3e74aa3d1e87 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.614466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.616501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.616855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.617145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.617925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.618063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1268/2510] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:23 2022] PUT /identity/v3/projects/491bae5f8bf44db2b25a204d662f6914/users/1d4bfe02981c429b8633e4e02efebc1b/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:23.619853 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.628666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.629086 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.629936 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.660664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] MFA Rules not processed for user `1d4bfe02981c429b8633e4e02efebc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:23.662419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:23.729969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1243/2511] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:34:23.735517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.750017 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1269/2512] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:23.772342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.773986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:23.809786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be20069-0f71-4da6-b7e1-f7aa83d8b22b admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.814565 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.815307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.815596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.815874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.816560 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.819148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.840850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28749c57-6970-480d-8bf3-843dfefa2f0c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.860398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:23.891618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.892273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.892556 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.892872 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.909931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1244/2513] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:23 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:23.910988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.921613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d10a-f795-48c8-b376-d3f8329e09cd admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.926785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.928046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.928386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.928703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.929448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.931229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.942667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1245/2514] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:23.947534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:23.956696 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.957770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56b9d8-fbe5-471f-ba0d-2cde88241cc7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:23.958486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:23.962845 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:23.963706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:23.963998 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:23.964297 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] PATH_INFO: `/v3/projects/b8688b5232af4f1ab49fe37b791aa891/users/a8606c542aa64170a021892489b3aa12/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:23.969807 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1270/2515] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:34:23.981867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8688b5232af4f1ab49fe37b791aa891, user_id=a8606c542aa64170a021892489b3aa12, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:23.985177 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:24.062503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1246/2516] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:23 2022] PUT /identity/v3/projects/b8688b5232af4f1ab49fe37b791aa891/users/a8606c542aa64170a021892489b3aa12/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:24.064848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:24.077760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98580e6-ea8d-4a08-be54-880c16f6370c service glance] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:24.142003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:24.142874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:24.143306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:24.143756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:24.144921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:24.146697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6169e-5fb9-4b19-84b4-96c2fdd3d4b2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:24.163297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1271/2517] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:24.164410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:24.175589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1297d9-86f0-4150-a63c-3dcd419d587c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:24.181197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:24.182949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:24.182949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:24.182949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] PATH_INFO: `/v3/projects/b8688b5232af4f1ab49fe37b791aa891/users/a8606c542aa64170a021892489b3aa12/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:24.184623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8688b5232af4f1ab49fe37b791aa891, user_id=a8606c542aa64170a021892489b3aa12, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:24.187280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:24.198880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1247/2518] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:24 2022] PUT /identity/v3/projects/b8688b5232af4f1ab49fe37b791aa891/users/a8606c542aa64170a021892489b3aa12/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:24.208969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:24.209271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:24.209565 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:24.237692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] MFA Rules not processed for user `a8606c542aa64170a021892489b3aa12`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:24.239171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:24.303732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=100 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:24.309055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1272/2519] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:24.320498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:24.322323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:24.381386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d7d24-516e-4bac-a058-e17d4adce773 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:24.385110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:24.385755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:24.386043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:24.386318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:24.395351 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:24.397401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:24.406992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1248/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:24.560460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:24.571635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6ec1-d199-4a62-b78b-b162465407b6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:24.575384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:24.577317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:24.577317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:24.577317 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:24.635592 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:24.637102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2ff27-5bd8-49ce-856c-eecdd75b661a service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:24.646036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1273/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:25.100343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:25.121755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:25.166726 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaff3e-d6cd-49ce-b707-43aa858fb0c3 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:25.171361 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:25.172254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:25.173368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:25.173368 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] PATH_INFO: `/v3/users/838fac6712b24c3985becd86ead049b8` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:25.174173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838fac6712b24c3985becd86ead049b8)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:25.176101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:25.371101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838fac6712b24c3985becd86ead049b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:25.384630 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838fac6712b24c3985becd86ead049b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:25.385597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838fac6712b24c3985becd86ead049b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:25.386056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838fac6712b24c3985becd86ead049b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:25.455799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838fac6712b24c3985becd86ead049b8'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:25.469691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1249/2522] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:25 2022] DELETE /identity/v3/users/838fac6712b24c3985becd86ead049b8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:25.474386 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:25.474860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:25.474975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:25.493894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:25.495423 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:25.558728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1274/2523] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:25.568234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:25.569645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:25.632997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9a2e-3dd0-4eb1-a3d3-b7dea476da66 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:25.636705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:25.637359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:25.637649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:25.637936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:25.646896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:25.648864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:25.658654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1250/2524] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:26.068434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:26.070046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:26.084268 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d1904-7ddb-4633-9ccf-0829f59eec50 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:26.090724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:26.091634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:26.091921 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:26.092202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] PATH_INFO: `/v3/projects/78aacddcc78f4e98af435debc7444ff3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:26.093626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aacddcc78f4e98af435debc7444ff3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:26.095443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:26.232686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aacddcc78f4e98af435debc7444ff3', 'request_id': 'req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.310595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aacddcc78f4e98af435debc7444ff3', 'request_id': 'req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.317572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aacddcc78f4e98af435debc7444ff3', 'request_id': 'req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.329496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] The token cache is being invalidate because project 78aacddcc78f4e98af435debc7444ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:26.329797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.330500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.332217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1275/2525] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:26 2022] DELETE /identity/v3/projects/78aacddcc78f4e98af435debc7444ff3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:26.336288 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:26.346187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f858b-fb20-43b6-99c6-a977f224d8e9 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:26.390280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:26.406341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:26.407217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:26.407502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:26.407781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] PATH_INFO: `/v3/users/a8606c542aa64170a021892489b3aa12` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:26.409051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8606c542aa64170a021892489b3aa12)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:26.410983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:26.610542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8606c542aa64170a021892489b3aa12'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.622520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8606c542aa64170a021892489b3aa12'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.623203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8606c542aa64170a021892489b3aa12'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.623836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8606c542aa64170a021892489b3aa12'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.705116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d714643-3071-4ef3-8562-b13079642a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8606c542aa64170a021892489b3aa12'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:26.719296 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1251/2526] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:34:26 2022] DELETE /identity/v3/users/a8606c542aa64170a021892489b3aa12 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:27.131411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.133152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:27.151053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230acb3-8b3e-43fd-a7a2-9b9e12c91d93 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.170080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:27.213131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.214101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.214447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.214920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] PATH_INFO: `/v3/projects/b8688b5232af4f1ab49fe37b791aa891` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.216153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8688b5232af4f1ab49fe37b791aa891)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.218140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:27.314336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8688b5232af4f1ab49fe37b791aa891', 'request_id': 'req-32397fd1-29fd-459b-a69c-2620b11b8fd3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:27.396424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8688b5232af4f1ab49fe37b791aa891', 'request_id': 'req-32397fd1-29fd-459b-a69c-2620b11b8fd3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:27.404368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8688b5232af4f1ab49fe37b791aa891', 'request_id': 'req-32397fd1-29fd-459b-a69c-2620b11b8fd3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:27.414740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] The token cache is being invalidate because project b8688b5232af4f1ab49fe37b791aa891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:34:27.415245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:27.415878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-32397fd1-29fd-459b-a69c-2620b11b8fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:34:27.417793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1276/2527] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:34:27 2022] DELETE /identity/v3/projects/b8688b5232af4f1ab49fe37b791aa891 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:34:27.424036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.424556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.424664 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.442901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:27.446638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:27.509169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1252/2528] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:34:27.517116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.517416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.517704 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.538224 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:27.539457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:27.547575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1277/2529] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:27.551650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.562086 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35f16-d3a4-4846-8203-f98e37654397 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.566686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.567346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.567635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.567920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.568714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:34:27.569030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.570627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:27.584031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1253/2530] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:34:27.588488 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.597735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a309bd1-0b12-4341-9ed2-f921020365de None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.602694 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.603365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.603656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.603940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.604672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.606848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:27.725861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1278/2531] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:34:27 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:27.731245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.741902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4d3b-6cbd-4392-9e71-984c0a3c5fa3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.792999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:27.804582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.805788 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.806074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.806358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.807037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.808986 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:27.940192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1254/2532] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:34:27 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:34:27.944235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.955836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10dac-df48-4a85-b59e-c4fedd0adfe8 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.960409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.961101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.962003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.962334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.963043 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.964662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:27.974947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1279/2533] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:27.978765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:27.991062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7c4f9-0575-416d-9d18-af5c51be4ef7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:27.996179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:27.996897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:27.997339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:27.997625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:27.998357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:27.999970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1485206-3425-45be-9a57-ad6a0a71b577 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:28.011524 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1255/2534] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:34:28.015776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:28.026482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8484d3-8c39-4d0d-9390-263b45f37ab7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:28.031005 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:28.031912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:28.032203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:28.032486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] PATH_INFO: `/v3/projects/c5c4b6ad525d438a95ac54173ffe8201/users/14494cf98bfa4250950fbc4637b570b3/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:28.048982 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c4b6ad525d438a95ac54173ffe8201, user_id=14494cf98bfa4250950fbc4637b570b3, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:28.051827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:28.124784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1280/2535] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:34:28 2022] PUT /identity/v3/projects/c5c4b6ad525d438a95ac54173ffe8201/users/14494cf98bfa4250950fbc4637b570b3/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:34:28.139032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:28.139370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:28.139685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:28.168868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] MFA Rules not processed for user `14494cf98bfa4250950fbc4637b570b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:34:28.170116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:28.245506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1256/2536] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:34:28.256874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:34:28.259301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:34:28.313296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:28.318621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3caf-2c64-4300-9971-ca21f2c5058e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:34:28.322481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:34:28.323138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:34:28.330207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:34:28.330207 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:34:28.332150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:34:28.333611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cad3d-db7f-41ca-9f85-2bd25902c475 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:34:28.342948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1281/2537] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:34:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:34:38.242162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:34:38.424848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:06.401334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:06.402749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:06.472386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfabcbd-b94a-4e3b-8a89-6858ec069277 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:06.477659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:06.478564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:06.478854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:06.479136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] PATH_INFO: `/v3/users/1d4bfe02981c429b8633e4e02efebc1b` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:06.480366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4bfe02981c429b8633e4e02efebc1b)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:06.482611 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:06.664590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4bfe02981c429b8633e4e02efebc1b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:06.677401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4bfe02981c429b8633e4e02efebc1b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:06.678100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4bfe02981c429b8633e4e02efebc1b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:06.678721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4bfe02981c429b8633e4e02efebc1b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:06.735306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4bfe02981c429b8633e4e02efebc1b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:06.749923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1257/2538] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:35:06 2022] DELETE /identity/v3/users/1d4bfe02981c429b8633e4e02efebc1b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:06.754816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:06.755331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:06.755431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:06.772121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:06.773352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:06.834951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1282/2539] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:06.845499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:06.846902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:06.915674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f07bdf-c1eb-4f26-b0c8-96f50ae5d20d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:06.920061 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:06.921126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:06.921455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:06.921743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:06.931686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:06.933171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046fd27-c3e1-4165-87f7-a447d29a39eb service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:06.942695 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1258/2540] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:35:07.354183 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:07.355604 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:07.377778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee35ee-efc5-4f7f-bbfe-6c749c3226ea None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:07.383141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:07.384046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:07.384331 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:07.384602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] PATH_INFO: `/v3/projects/491bae5f8bf44db2b25a204d662f6914` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:07.385911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=491bae5f8bf44db2b25a204d662f6914)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:07.387859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:07.594597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491bae5f8bf44db2b25a204d662f6914', 'request_id': 'req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:07.656636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491bae5f8bf44db2b25a204d662f6914', 'request_id': 'req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:07.663671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491bae5f8bf44db2b25a204d662f6914', 'request_id': 'req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:07.674598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] The token cache is being invalidate because project 491bae5f8bf44db2b25a204d662f6914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:35:07.674876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:07.675601 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e64a8041-f3b0-4b2c-8ff8-3bb2cd342b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:07.677277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1283/2541] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:35:07 2022] DELETE /identity/v3/projects/491bae5f8bf44db2b25a204d662f6914 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:07.683021 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:07.683548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:07.683895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:07.703178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:07.704363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:07.712841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:07.766572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1259/2542] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:07.774707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:07.776201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:07.776201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:07.793990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:07.795200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:07.803708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1284/2543] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:07.808245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:07.818138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad2661-614b-4031-8a23-53db7dc67b44 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:07.822708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:07.823359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:07.823644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:07.823924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:07.824782 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:35:07.825091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:07.826692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:07.838857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1260/2544] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:35:07.843697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:07.852902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b05a6-08e8-4c7c-8cdc-7f76d6db1156 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:07.857963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:07.858749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:07.858986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:07.859285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:07.859989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:07.861903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:07.974846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1285/2545] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:35:07 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:35:07.978589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:07.989248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec359-ee0b-492e-bbca-d8b57d915f58 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:08.048997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:08.049678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.049974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.050259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.050945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:08.052931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:08.152992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1261/2546] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:35:07 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:35:08.157146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:08.167900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033f48-6e07-4f9f-ac99-cd65d418a7a5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:08.172857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:08.173518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.173810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.174095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.174824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:08.176437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:08.187659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1286/2547] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:35:08.197230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:08.208095 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2782-ba98-4d38-84ca-d61a4fb92c27 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:08.212833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:08.213494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.213787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.214072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.214806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:08.216423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5bd5-9b1a-45df-98c0-e3427238ff8c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:08.227149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1262/2548] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:35:08.231335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:08.241536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73274e8-3d2c-4fc7-86e2-f2181eb9330a admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:08.246218 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:08.247100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.247387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.247671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] PATH_INFO: `/v3/projects/f88d1565660d4f8fa78873491d586f9c/users/f67c6d1917c34eaa906d83019ff4ec18/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.267239 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88d1565660d4f8fa78873491d586f9c, user_id=f67c6d1917c34eaa906d83019ff4ec18, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:08.270155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:08.360077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1287/2549] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:35:08 2022] PUT /identity/v3/projects/f88d1565660d4f8fa78873491d586f9c/users/f67c6d1917c34eaa906d83019ff4ec18/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:08.370352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.370647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.370929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.401240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] MFA Rules not processed for user `f67c6d1917c34eaa906d83019ff4ec18`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:08.402467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:08.473378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1263/2550] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:08.487697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:08.489444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:08.511723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:08.547613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eed70-d000-47de-99c2-ff9892cb66f9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:08.551729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:08.552382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:08.552701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:08.552985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:08.564863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:08.564863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e04ea-1579-4155-8a08-f6dc4dedfa38 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:08.572600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1288/2551] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:35:18.470453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:18.678256 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=17 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:32.779870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:32.855535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44383a37-291d-4c0a-90cf-66fa9096830c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:32.860253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:32.861781 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:32.862074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:32.862359 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] PATH_INFO: `/v3/users/f67c6d1917c34eaa906d83019ff4ec18` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:32.863569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67c6d1917c34eaa906d83019ff4ec18)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:32.865554 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:33.063400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67c6d1917c34eaa906d83019ff4ec18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.076068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67c6d1917c34eaa906d83019ff4ec18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.076775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67c6d1917c34eaa906d83019ff4ec18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.077391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67c6d1917c34eaa906d83019ff4ec18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.140934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67c6d1917c34eaa906d83019ff4ec18'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.153924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1264/2552] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:35:32 2022] DELETE /identity/v3/users/f67c6d1917c34eaa906d83019ff4ec18 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:33.158987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:33.159984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:33.159984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:33.176380 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:33.177641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:33.245655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1289/2553] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:33.255423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:33.256869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:33.319221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950292b-9d38-4b9d-9818-d556da4d88df admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:33.322835 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:33.323483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:33.323769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:33.324050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:33.333651 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:33.335075 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:33.344414 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1265/2554] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:35:33.747925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:33.749395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:33.762046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593f511-872e-497f-8f62-83e992d3b8a8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:33.766848 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:33.768548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:33.768892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:33.769171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] PATH_INFO: `/v3/projects/f88d1565660d4f8fa78873491d586f9c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:33.770392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88d1565660d4f8fa78873491d586f9c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:33.772334 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:33.880467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88d1565660d4f8fa78873491d586f9c', 'request_id': 'req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.962428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88d1565660d4f8fa78873491d586f9c', 'request_id': 'req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.968971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88d1565660d4f8fa78873491d586f9c', 'request_id': 'req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.979641 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] The token cache is being invalidate because project f88d1565660d4f8fa78873491d586f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:35:33.979931 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.980582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-cb2b61a5-7b15-4d2c-b3c9-34b712a114b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:33.982404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1290/2555] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:35:33 2022] DELETE /identity/v3/projects/f88d1565660d4f8fa78873491d586f9c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:43.340149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:43.976557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:44.635996 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:44.637463 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:44.651067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2183d40-69d7-4f06-8a1e-7652f723b66b service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:44.706731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:44.707684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:44.707969 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:44.708245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] PATH_INFO: `/v3/users/14494cf98bfa4250950fbc4637b570b3` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:44.709465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14494cf98bfa4250950fbc4637b570b3)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:44.711387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:44.913140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14494cf98bfa4250950fbc4637b570b3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:44.924847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14494cf98bfa4250950fbc4637b570b3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:44.925928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14494cf98bfa4250950fbc4637b570b3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:44.926686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14494cf98bfa4250950fbc4637b570b3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.002105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14494cf98bfa4250950fbc4637b570b3'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.016265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1266/2556] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:35:44 2022] DELETE /identity/v3/users/14494cf98bfa4250950fbc4637b570b3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:45.021290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:45.021668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:45.021764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:45.051847 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:45.053221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:45.119130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1291/2557] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:35:45.129078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:45.130490 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:45.203025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e1347-d204-45f2-99a6-afb0f578b848 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:45.207941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:45.208926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:45.209407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:45.209882 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:45.223134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:45.224659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00c68f-6c85-48a5-8097-3afaa1ae96b4 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:45.237448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1267/2558] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:35:45.653824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:45.655941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:45.670298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d0293-1a1c-41b6-b6cb-32bf68264ce4 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:45.677195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:45.683389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:45.683711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:45.684011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] PATH_INFO: `/v3/projects/c5c4b6ad525d438a95ac54173ffe8201` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:45.685501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c4b6ad525d438a95ac54173ffe8201)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:45.688658 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:45.794213 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c4b6ad525d438a95ac54173ffe8201', 'request_id': 'req-92cc1154-4867-4e9a-9339-2899465d6553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.871220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c4b6ad525d438a95ac54173ffe8201', 'request_id': 'req-92cc1154-4867-4e9a-9339-2899465d6553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.879136 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c4b6ad525d438a95ac54173ffe8201', 'request_id': 'req-92cc1154-4867-4e9a-9339-2899465d6553'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.890718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] The token cache is being invalidate because project c5c4b6ad525d438a95ac54173ffe8201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:35:45.891011 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.891714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92cc1154-4867-4e9a-9339-2899465d6553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:35:45.893350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1292/2559] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:35:45 2022] DELETE /identity/v3/projects/c5c4b6ad525d438a95ac54173ffe8201 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:45.900194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:45.900775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:45.900775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:45.920347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:45.921631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:45.940692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:45.983151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1268/2560] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:35:45.993406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:45.993406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:45.993406 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.011306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:46.012502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:46.020505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1293/2561] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:46.024680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.034322 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ce66-7ca9-4f52-875e-0753c5dd3942 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.039439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.040092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.040376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.040684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.041405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:35:46.041711 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.043352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.056215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1269/2562] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:35:46.060566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.070457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b1f7-57a5-45ea-b1ba-cfe123991d13 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.075666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.075951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.076240 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.076549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.077283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.079424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.211759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1294/2563] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:35:46 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:35:46.215770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.234145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5b57f-847d-4498-af2a-b6f7fae08bf5 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.291042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.291628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.291922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.292200 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.292925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.294847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.399224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1270/2564] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:35:46 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:35:46.403542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.414303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc280a5-ec6e-4690-9230-b8b0acd4339b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.418917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.419576 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.419861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.420138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.420898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.422494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.433295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1295/2565] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:35:46.437391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.447841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a69d1-44ef-4075-a768-bfe1a7272054 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.452449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.453143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.453436 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.453715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.454441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.456042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b45c7b-5ce5-4eeb-aa29-90f4e270cf31 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.466696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1271/2566] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:35:46.470767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.480542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea9985-ad74-4080-9286-4ec7d15b815d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.485387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.486254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.486535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.486808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] PATH_INFO: `/v3/projects/2aa0ba504474450e96a3ecba86d87b75/users/3c1c33adc900455799910e81d4d19e75/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.502178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa0ba504474450e96a3ecba86d87b75, user_id=3c1c33adc900455799910e81d4d19e75, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.505623 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.587499 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1296/2567] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:35:46 2022] PUT /identity/v3/projects/2aa0ba504474450e96a3ecba86d87b75/users/3c1c33adc900455799910e81d4d19e75/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:35:46.598876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.599172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.607540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.626970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] MFA Rules not processed for user `3c1c33adc900455799910e81d4d19e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:35:46.628397 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:46.694231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1272/2568] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:35:46.704985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:35:46.707682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:35:46.730141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:46.766155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059990-a043-46ad-be23-a2514c180302 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:35:46.770730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:35:46.771375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:35:46.771668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:35:46.771980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:35:46.780541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:35:46.781995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1851c57-6a1b-4371-a3c6-5007107bab52 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:35:46.792261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1297/2569] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:35:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:35:56.691160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:35:56.815325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=17 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:11.404814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:11.467044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240a76-ed2c-46b3-b8dd-b7b39d8c47da None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:11.471616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:11.472501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:11.472838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:11.473115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] PATH_INFO: `/v3/users/3c1c33adc900455799910e81d4d19e75` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:11.474305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1c33adc900455799910e81d4d19e75)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:11.477070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:11.651716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1c33adc900455799910e81d4d19e75'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:11.663894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1c33adc900455799910e81d4d19e75'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:11.664578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1c33adc900455799910e81d4d19e75'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:11.665239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1c33adc900455799910e81d4d19e75'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:11.728950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1c33adc900455799910e81d4d19e75'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:11.742287 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1273/2570] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:36:11 2022] DELETE /identity/v3/users/3c1c33adc900455799910e81d4d19e75 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:36:11.746787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:11.747295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:11.747678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:11.772715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:36:11.774010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:11.831461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1298/2571] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:36:11.841642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:11.843145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:11.901502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd455a40-5b05-4936-b973-fb0a906490bc admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:11.905229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:11.905814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:11.906101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:11.906380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:11.915390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:11.916865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:11.926189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1274/2572] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:36:12.337087 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:12.338642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:12.352466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf2a4b-c942-44b7-9b77-c9ac438755a8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:12.366076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:12.366076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:12.366076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:12.366076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] PATH_INFO: `/v3/projects/2aa0ba504474450e96a3ecba86d87b75` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:12.366579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa0ba504474450e96a3ecba86d87b75)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:12.367722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:12.473027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa0ba504474450e96a3ecba86d87b75', 'request_id': 'req-7392af7e-6f7d-43c9-a90d-04d740a938eb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:12.540884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa0ba504474450e96a3ecba86d87b75', 'request_id': 'req-7392af7e-6f7d-43c9-a90d-04d740a938eb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:12.547426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa0ba504474450e96a3ecba86d87b75', 'request_id': 'req-7392af7e-6f7d-43c9-a90d-04d740a938eb'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:12.558617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] The token cache is being invalidate because project 2aa0ba504474450e96a3ecba86d87b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:36:12.558909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:12.559549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:36:12.561225 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1299/2573] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:36:12 2022] DELETE /identity/v3/projects/2aa0ba504474450e96a3ecba86d87b75 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:36:16.519555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:16.520973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:16.550580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:16.583373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6677-620d-46c2-af7c-ac241bc829ec service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:16.634142 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:16.634790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:16.635072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:16.635353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:16.637981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:16.709521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:16.711515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:16.720577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1275/2574] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:36:22.555691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:24.689568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:24.691150 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:24.764064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392af7e-6f7d-43c9-a90d-04d740a938eb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:24.767668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:24.768316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:24.768622 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:24.768920 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:24.770688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:24.780671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:24.782104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:24.790597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1300/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:36:26.716393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=63 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:34.786583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=31 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:41.723829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:41.725294 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:41.823210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d174-c866-443c-bcc2-355b08ff06d4 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:41.828730 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:41.832188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:41.832188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:41.832188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:41.832188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:41.890768 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:41.892376 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:41.902669 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1276/2576] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:36:51.897308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=61 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:36:53.997974 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:53.999368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:54.011965 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2017bb-2afd-4fc4-b7a1-fe5b13e82c49 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:54.015564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:54.016198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:54.016513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:54.016825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:54.018683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:54.032311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:54.033849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:36:54.045455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1301/2577] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:36:59.952504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:36:59.964752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa52a7-c22d-4f15-a126-77499d16cd38 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:36:59.972048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:36:59.972900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:36:59.973195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:36:59.973485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:36:59.975989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:36:59.989577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:36:59.991420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:00.003568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1277/2578] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:37:04.040630 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:06.513447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:06.523402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768a05-1dc7-4b99-bc59-b7ea38afa90c service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:06.527071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:06.527752 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:06.528121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:06.528404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:06.530152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:06.592925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:06.594364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:06.604157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1302/2579] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:09.999097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:10.027771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:10.029247 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:10.099608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ada6-c529-4463-9deb-813910976195 service nova] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:10.105370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:10.106221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:10.106506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:10.106787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:10.108567 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:10.121385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:10.123046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:10.133161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1278/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:10.150359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:10.151886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:10.172323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68259f-f7c9-4dbd-9f67-9a17eb6ee208 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:10.177503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:10.179058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:10.179335 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:10.179637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] PATH_INFO: `/v3/users/09cd0b66ae0145cb9e533335e23e2dc9` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:10.180923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cd0b66ae0145cb9e533335e23e2dc9)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:10.182866 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:10.332101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cd0b66ae0145cb9e533335e23e2dc9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.332795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cd0b66ae0145cb9e533335e23e2dc9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.340737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cd0b66ae0145cb9e533335e23e2dc9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.341389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cd0b66ae0145cb9e533335e23e2dc9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.489444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-ad5f21c8-4832-45e9-9e53-a733032c5319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cd0b66ae0145cb9e533335e23e2dc9'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.513190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1303/2581] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:10 2022] DELETE /identity/v3/users/09cd0b66ae0145cb9e533335e23e2dc9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:10.752523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:10.765561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf3ada-85e7-4e56-a4cd-ee6dc16336d0 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:10.824863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:10.825762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:10.826054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:10.826338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] PATH_INFO: `/v3/projects/53f65cad94804849bf57f4533761ab3c` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:10.827561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f65cad94804849bf57f4533761ab3c)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:10.829517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:10.934530 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f65cad94804849bf57f4533761ab3c', 'request_id': 'req-95933350-4f71-4d2e-9d40-f14435b1aa16'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.940987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f65cad94804849bf57f4533761ab3c', 'request_id': 'req-95933350-4f71-4d2e-9d40-f14435b1aa16'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:10.947179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f65cad94804849bf57f4533761ab3c', 'request_id': 'req-95933350-4f71-4d2e-9d40-f14435b1aa16'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:11.018632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] The token cache is being invalidate because project 53f65cad94804849bf57f4533761ab3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:11.019232 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:11.019489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-95933350-4f71-4d2e-9d40-f14435b1aa16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:11.021085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1279/2582] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:10 2022] DELETE /identity/v3/projects/53f65cad94804849bf57f4533761ab3c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:11.026153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.026448 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.026729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.044994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:11.046193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:11.106518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1304/2583] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:11.115024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.115319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.115663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.138364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:11.143543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:11.150311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1280/2584] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:37:11.154621 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.165473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6562aa-52ff-4627-83a5-d7f6b9c18af6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.170258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.170944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.171237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.171520 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.172253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:11.172568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.174180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.175670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:11.186564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1305/2585] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:11.192391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.202184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8c7a5-8249-4a02-abd0-d1f3f1be74d5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.206916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.212445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.212445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.212445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.212445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.212445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.222057 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:11.313733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1281/2586] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:11.315599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.327352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fa3a0-cd0d-4daa-99f8-1504a50c5673 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.389305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.390095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.390388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.390666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.391350 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.393315 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.513306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1306/2587] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:37:11.517520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.528654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899dc17-9db0-49a2-a990-64da2fa51604 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.533146 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.533861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.534144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.534427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.535156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.536877 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.547500 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1282/2588] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:11.551850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.562548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba716f3-8e65-49cc-8b33-1cff0305dd54 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.567241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.569529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.569529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.569529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.570590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.572365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57607e-9547-4beb-99f1-d8dd784aa959 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.582596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1307/2589] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:37:11.587234 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.597155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf091ab-8da2-4b82-9461-235b0bb37413 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.601972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.602871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.603161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.603439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] PATH_INFO: `/v3/projects/eeb90786591c410e9254a8957f852f5d/users/fdfd8e2b834745699da03f2880ac1fda/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.619356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb90786591c410e9254a8957f852f5d, user_id=fdfd8e2b834745699da03f2880ac1fda, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.622167 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.701701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1283/2590] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:11 2022] PUT /identity/v3/projects/eeb90786591c410e9254a8957f852f5d/users/fdfd8e2b834745699da03f2880ac1fda/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:11.712445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.712777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.713061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.740007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] MFA Rules not processed for user `fdfd8e2b834745699da03f2880ac1fda`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:11.741421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:11.805922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1308/2591] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:11.810279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:11.874939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605b65-e7a8-4ec0-89cf-9d30731c7a2c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:11.879588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:11.880249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:11.880541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:11.880854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:11.882673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:11.884596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:11.988016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1284/2592] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:11.993780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.007989 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5924fc3-e16f-45b3-af44-842db311564f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.063174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.063768 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.064054 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.064332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.065051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.066947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.075165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:12.169489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1309/2593] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:11 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:12.173485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.184763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38549-74dd-4634-b289-ad725382045c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.189557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.190224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.190515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.190798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.191557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.193209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.205728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1285/2594] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:12.210113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.220290 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e295-b971-4cf8-8ac8-9a5344386ccd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.225478 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.226502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.226791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.227073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] PATH_INFO: `/v3/projects/6f3bab9a643444e9a84f170900a90254/users/ac3b40b7501d45108c1b36fe092e4787/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.243688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3bab9a643444e9a84f170900a90254, user_id=ac3b40b7501d45108c1b36fe092e4787, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.246413 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.311597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1310/2595] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:12 2022] PUT /identity/v3/projects/6f3bab9a643444e9a84f170900a90254/users/ac3b40b7501d45108c1b36fe092e4787/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:12.315614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.325540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8113-91d5-4f81-8fba-598ee417a99d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.383867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.384545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.384867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.385148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.385879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.387494 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f481-5249-4e4b-99fe-8909c1126768 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.398128 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1286/2596] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:12.401978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.412138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66e0-0a97-4bc4-a494-4453d35358c5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.417534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.418416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.418702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.418978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] PATH_INFO: `/v3/projects/6f3bab9a643444e9a84f170900a90254/users/ac3b40b7501d45108c1b36fe092e4787/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.420972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3bab9a643444e9a84f170900a90254, user_id=ac3b40b7501d45108c1b36fe092e4787, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.423639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.434759 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1311/2597] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:12 2022] PUT /identity/v3/projects/6f3bab9a643444e9a84f170900a90254/users/ac3b40b7501d45108c1b36fe092e4787/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:37:12.444932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.448900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.448900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.473006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] MFA Rules not processed for user `ac3b40b7501d45108c1b36fe092e4787`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:12.474226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:12.487824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:12.543723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1287/2598] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:12.556048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:12.557826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:12.617033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450e8c-5737-4c2f-b54e-0a68a92e1769 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:12.620720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:12.621363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:12.621711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:12.622001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:12.630987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:12.633355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb5a5-7151-4fcb-bb6b-5662f89a5608 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:12.642747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1312/2599] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:13.483510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:13.544990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2682a-1a41-401d-855a-d123c06b5567 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:13.549580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:13.550455 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:13.550741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:13.551018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] PATH_INFO: `/v3/users/fdfd8e2b834745699da03f2880ac1fda` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:13.552205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfd8e2b834745699da03f2880ac1fda)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:13.554240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:13.697856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfd8e2b834745699da03f2880ac1fda'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:13.709805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfd8e2b834745699da03f2880ac1fda'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:13.710467 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfd8e2b834745699da03f2880ac1fda'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:13.711083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfd8e2b834745699da03f2880ac1fda'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:13.785188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfd8e2b834745699da03f2880ac1fda'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:13.797999 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1288/2600] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:13 2022] DELETE /identity/v3/users/fdfd8e2b834745699da03f2880ac1fda => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:13.802769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:13.803798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:13.803798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:13.821568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:13.822769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:13.881016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1313/2601] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:37:13.890504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:13.891894 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:13.926037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:13.950000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8659f8-514d-4f13-8159-8cbb1d8220f1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:13.953586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:13.954235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:13.954547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:13.954832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:13.964865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:13.966310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:13.975772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1289/2602] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:14.364984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:14.370870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:14.379797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81d0a-95cf-45e3-b74d-0764b72cd696 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:14.385930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:14.386815 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:14.387091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:14.387930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] PATH_INFO: `/v3/projects/eeb90786591c410e9254a8957f852f5d` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:14.388570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb90786591c410e9254a8957f852f5d)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:14.390529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:14.520915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb90786591c410e9254a8957f852f5d', 'request_id': 'req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.523482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:14.598173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb90786591c410e9254a8957f852f5d', 'request_id': 'req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.606561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb90786591c410e9254a8957f852f5d', 'request_id': 'req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.617435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] The token cache is being invalidate because project eeb90786591c410e9254a8957f852f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:14.618540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.619427 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.621049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1314/2603] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:14 2022] DELETE /identity/v3/projects/eeb90786591c410e9254a8957f852f5d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:14.625217 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:14.635639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb335ef-a65f-4582-957c-f8de487a7e72 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:14.693910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:14.694789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:14.695076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:14.695358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] PATH_INFO: `/v3/users/ac3b40b7501d45108c1b36fe092e4787` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:14.697112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3b40b7501d45108c1b36fe092e4787)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:14.699131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:14.886123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3b40b7501d45108c1b36fe092e4787'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.897791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3b40b7501d45108c1b36fe092e4787'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.898444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3b40b7501d45108c1b36fe092e4787'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.899719 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3b40b7501d45108c1b36fe092e4787'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.963609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-5f445755-5c5c-43fb-a7c5-6daabc54ee0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3b40b7501d45108c1b36fe092e4787'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:14.976566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1290/2604] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:14 2022] DELETE /identity/v3/users/ac3b40b7501d45108c1b36fe092e4787 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:15.393973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:15.395909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:15.409321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a7c9c-70eb-440f-b9d3-72f7bc2488e4 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:15.468986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:15.469852 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.470140 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.470530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] PATH_INFO: `/v3/projects/6f3bab9a643444e9a84f170900a90254` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.471720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3bab9a643444e9a84f170900a90254)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:15.473679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:15.569608 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3bab9a643444e9a84f170900a90254', 'request_id': 'req-4b50ef2a-b384-42da-94bf-62b6f641286d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:15.626180 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3bab9a643444e9a84f170900a90254', 'request_id': 'req-4b50ef2a-b384-42da-94bf-62b6f641286d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:15.632901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3bab9a643444e9a84f170900a90254', 'request_id': 'req-4b50ef2a-b384-42da-94bf-62b6f641286d'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:15.644104 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] The token cache is being invalidate because project 6f3bab9a643444e9a84f170900a90254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:15.644351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:15.644993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4b50ef2a-b384-42da-94bf-62b6f641286d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:15.646567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1315/2605] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:15 2022] DELETE /identity/v3/projects/6f3bab9a643444e9a84f170900a90254 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:15.651916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.662922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.662922 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.670390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:15.672005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:15.718919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:15.730556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1291/2606] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:15.739539 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.739835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.743867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.763817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:15.765075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:15.773142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1316/2607] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:15.778214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:15.787838 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb9e4d-c793-4654-87a9-c90d17dfd4b1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:15.793738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:15.794395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.794686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.794970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.795696 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:15.796008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:15.797642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:15.809236 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1292/2608] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:15.813384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:15.822644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b792f4-1294-4e1a-b120-225b40732ec1 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:15.827296 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:15.829198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.829198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.829198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.829595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:15.831111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:15.913232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1317/2609] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:15 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:15.917734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:15.927741 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a684af-9b9d-4f10-8007-64fb80c04178 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:15.984720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:15.985395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:15.985687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:15.985972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:15.986660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:15.988595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.089935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1293/2610] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:15 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:16.093983 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.104162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11dcff-afa7-4ba2-b1cc-1157ab217108 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.108988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.109640 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.109924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.110201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.110916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.112572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.123148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1318/2611] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:16.126952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.138127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882926f-3efe-4503-be1e-6ab5ddd51db6 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.142906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.143566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.143858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.144145 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.144910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.146517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2a5b6-9339-4442-9890-f134bded46fd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.158954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1294/2612] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:16.163363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.173562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84868ea-5b71-4899-afbe-402c0907bf31 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.178270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.179147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.179435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.179712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] PATH_INFO: `/v3/projects/0b6fd32a0f0445e48c73c19d5ab63f2f/users/3db6e2dc8ad04501a3ecbfc66d06cb60/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.194977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6fd32a0f0445e48c73c19d5ab63f2f, user_id=3db6e2dc8ad04501a3ecbfc66d06cb60, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.198411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.296833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1319/2613] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:16 2022] PUT /identity/v3/projects/0b6fd32a0f0445e48c73c19d5ab63f2f/users/3db6e2dc8ad04501a3ecbfc66d06cb60/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:16.311613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.311906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.312190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.338453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] MFA Rules not processed for user `3db6e2dc8ad04501a3ecbfc66d06cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:16.339672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:16.405501 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1295/2614] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:16.410609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.420715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:16.474123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d64b85-ba30-47de-858d-7eea07f9e8ab admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.479541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.480203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.480494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.481080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.481801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.483741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.576492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1320/2615] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:16 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:16.577708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.589290 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51724b24-f9ce-48e2-b29d-d92cdc78f1e6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.634269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:16.645725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.646390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.646805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.647049 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.647745 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.649772 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.751102 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1296/2616] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:16 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:16.755161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.766320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88885b-1365-4fdc-ad28-ca90b2eb0c54 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.771049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.771715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.772008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.772295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.773071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.775330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.786016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1321/2617] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:16.790624 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.800518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d698a6-a614-4d1b-90da-c68a80c07f74 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.805118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.806657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.806950 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.807227 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] PATH_INFO: `/v3/projects/57e63db7733e48c5b14302497647b82b/users/89bf379cd7ef47078baa75074831b233/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.821599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e63db7733e48c5b14302497647b82b, user_id=89bf379cd7ef47078baa75074831b233, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.824245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.893985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1297/2618] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:16 2022] PUT /identity/v3/projects/57e63db7733e48c5b14302497647b82b/users/89bf379cd7ef47078baa75074831b233/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:16.897901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.908164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d8597-c8e2-490a-a003-c16218c61dc4 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.965744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:16.966415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:16.966706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:16.966986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:16.967711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:16.969345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396802-f5a3-4d1f-9cf5-d82560e8cc1a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:16.979715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1322/2619] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:16.984166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:16.994893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3043-dfdb-45bb-8e44-6092b8b67d81 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:16.999391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:17.000262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:17.000544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:17.000847 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] PATH_INFO: `/v3/projects/57e63db7733e48c5b14302497647b82b/users/89bf379cd7ef47078baa75074831b233/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:17.002832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e63db7733e48c5b14302497647b82b, user_id=89bf379cd7ef47078baa75074831b233, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:17.005459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:17.015479 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1298/2620] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:16 2022] PUT /identity/v3/projects/57e63db7733e48c5b14302497647b82b/users/89bf379cd7ef47078baa75074831b233/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:17.027083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:17.027385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:17.027675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:17.053720 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] MFA Rules not processed for user `89bf379cd7ef47078baa75074831b233`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:17.054928 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:17.123628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1323/2621] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:17.135575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:17.138003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:17.193700 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347aeb-2cbb-445e-9c30-d2dd4d6d0c1e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:17.198005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:17.198666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:17.198931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:17.199208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:17.208088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:17.209537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:17.220722 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1299/2622] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:17.462447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:17.467094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:17.472686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303ac0-ef7d-4a08-af6f-06917e19cc7e None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:17.476463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:17.476890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:17.477363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:17.477628 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:17.534165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:17.535540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4fbd1-660b-4378-9a53-c520ce17124a service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:17.544551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1324/2623] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:21.076081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:21.138120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f006-0997-40eb-872d-be13c3337cf5 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:21.142770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:21.143641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:21.143931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:21.144215 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] PATH_INFO: `/v3/users/3db6e2dc8ad04501a3ecbfc66d06cb60` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:21.145492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db6e2dc8ad04501a3ecbfc66d06cb60)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:21.149620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:21.341822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:21.343262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db6e2dc8ad04501a3ecbfc66d06cb60'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:21.356204 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db6e2dc8ad04501a3ecbfc66d06cb60'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:21.358032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db6e2dc8ad04501a3ecbfc66d06cb60'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:21.358032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db6e2dc8ad04501a3ecbfc66d06cb60'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:21.420545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db6e2dc8ad04501a3ecbfc66d06cb60'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:21.434489 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1300/2624] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:21 2022] DELETE /identity/v3/users/3db6e2dc8ad04501a3ecbfc66d06cb60 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:21.439089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:21.439617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:21.439722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:21.456991 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:21.458176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:21.522473 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1325/2625] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:21.532806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:21.534222 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:21.591011 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08e37-2d18-4b67-b9ad-57073325161a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:21.594738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:21.595327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:21.595620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:21.595903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:21.604934 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:21.606636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:21.616009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1301/2626] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:22.010613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:22.012195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:22.024886 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b70ae-a4e2-452a-8a6b-19f7b5eb0073 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:22.029740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:22.030664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:22.030967 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:22.031228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] PATH_INFO: `/v3/projects/0b6fd32a0f0445e48c73c19d5ab63f2f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:22.032417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6fd32a0f0445e48c73c19d5ab63f2f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:22.034370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:22.152434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6fd32a0f0445e48c73c19d5ab63f2f', 'request_id': 'req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.232192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6fd32a0f0445e48c73c19d5ab63f2f', 'request_id': 'req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.239375 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6fd32a0f0445e48c73c19d5ab63f2f', 'request_id': 'req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.250953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] The token cache is being invalidate because project 0b6fd32a0f0445e48c73c19d5ab63f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:22.251245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.251899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.253585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1326/2627] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:22 2022] DELETE /identity/v3/projects/0b6fd32a0f0445e48c73c19d5ab63f2f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:22.257528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:22.267170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d28d9-9ac3-46d2-8a56-2a3cd613c6f2 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:22.321830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:22.322691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:22.322975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:22.323252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] PATH_INFO: `/v3/users/89bf379cd7ef47078baa75074831b233` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:22.324419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bf379cd7ef47078baa75074831b233)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:22.326461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:22.503665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bf379cd7ef47078baa75074831b233'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.516168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bf379cd7ef47078baa75074831b233'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.516920 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bf379cd7ef47078baa75074831b233'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.517569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bf379cd7ef47078baa75074831b233'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.520281 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:22.620804 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e4474599-78c5-4122-ab24-36aee769bd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bf379cd7ef47078baa75074831b233'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:22.635391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1302/2628] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:22 2022] DELETE /identity/v3/users/89bf379cd7ef47078baa75074831b233 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:23.072596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.074387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:23.088917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c576f-6b23-47cf-816d-7be77c5bb1ad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.111772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:23.148843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.150294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.150801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.151090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] PATH_INFO: `/v3/projects/57e63db7733e48c5b14302497647b82b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.152373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e63db7733e48c5b14302497647b82b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.154393 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.306860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e63db7733e48c5b14302497647b82b', 'request_id': 'req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:23.374071 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e63db7733e48c5b14302497647b82b', 'request_id': 'req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:23.380758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e63db7733e48c5b14302497647b82b', 'request_id': 'req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:23.391554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] The token cache is being invalidate because project 57e63db7733e48c5b14302497647b82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:23.391862 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:23.392495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-15091f9f-afb3-44bb-bce6-ae5b7e1e9110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:23.394085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1327/2629] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:23 2022] DELETE /identity/v3/projects/57e63db7733e48c5b14302497647b82b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:23.398977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.400238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.400238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.419050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:23.420264 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:23.483553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1303/2630] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:23.491900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.492191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.492476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.512975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:23.514176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:23.522247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1328/2631] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:23.527997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.538607 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f63e75-da33-41e8-bdf3-7973835d7e78 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.543790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.544440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.544763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.545043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.545766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:23.546076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.547676 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.559245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1304/2632] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:23.563468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.573569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb1c07-16a0-4b21-91ef-639f3829c5ca None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.578307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.578964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.579253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.579535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.580237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.582206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.702146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1329/2633] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:23 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:37:23.706168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.716716 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882fc12-e5ad-4952-8b95-a7f764c95825 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.773089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.773749 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.774622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.775275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.775809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.777746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.869189 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1305/2634] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:23 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:23.873356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.884747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394764-df52-4157-90c4-820542f870fd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.889501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.890158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.890444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.890722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.891450 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.893079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.903522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1330/2635] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:23.907462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.918035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01952b40-dada-4a33-96c7-604434722cb3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.924907 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.925577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.925867 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.926147 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.926879 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.928520 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87591b-a6ac-4fa8-a745-decbe65508f0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:23.939743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1306/2636] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:23.943831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:23.956656 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019eef3-df31-4a9b-ba0b-73e9b61b18a9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:23.962827 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:23.963724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:23.964004 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:23.964302 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] PATH_INFO: `/v3/projects/62288ae517b84ab1844817f46a5e546a/users/e87eb0b2d394435ea2b6e5db0087d2a0/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:23.979145 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62288ae517b84ab1844817f46a5e546a, user_id=e87eb0b2d394435ea2b6e5db0087d2a0, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:23.982151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:24.055051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1331/2637] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:23 2022] PUT /identity/v3/projects/62288ae517b84ab1844817f46a5e546a/users/e87eb0b2d394435ea2b6e5db0087d2a0/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:24.065591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:24.065886 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:24.066170 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:24.092547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] MFA Rules not processed for user `e87eb0b2d394435ea2b6e5db0087d2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:24.093773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:24.134279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:24.159729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1307/2638] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:24.171875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:24.173722 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:24.242205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f21f-3edb-4cbc-829a-9d4656a65df6 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:24.248185 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:24.248828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:24.249238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:24.249668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:24.256934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:24.260773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:24.262208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3fb3f-1a03-4b2c-8cf2-218970ee756e service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:24.271103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1332/2639] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:34.203660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=9 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:34.323205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:53.092754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:53.173737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab62aba-0fa3-4de0-9262-736e3fdc13e9 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:53.178256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:53.179129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.179507 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.179702 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] PATH_INFO: `/v3/users/e87eb0b2d394435ea2b6e5db0087d2a0` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.180926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87eb0b2d394435ea2b6e5db0087d2a0)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:53.182846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:53.326342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87eb0b2d394435ea2b6e5db0087d2a0'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:53.338403 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87eb0b2d394435ea2b6e5db0087d2a0'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:53.339094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87eb0b2d394435ea2b6e5db0087d2a0'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:53.340418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87eb0b2d394435ea2b6e5db0087d2a0'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:53.414822 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87eb0b2d394435ea2b6e5db0087d2a0'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:53.427832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1308/2640] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:53 2022] DELETE /identity/v3/users/e87eb0b2d394435ea2b6e5db0087d2a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:53.432338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.432861 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.433569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.464365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:53.465706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:53.525534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1333/2641] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:37:53.534906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:53.536295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:53.594001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ae290-5add-4761-9c65-d0e2417c4185 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:53.597620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:53.598273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.598564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.598849 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.610757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:53.612248 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7e96a-543f-4924-a024-51990a12b76c service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:53.625795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1309/2642] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:54.022716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.024155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:54.037116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe32069-976f-4665-8d87-af2a34fcd1e6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.041160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.042114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.042439 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.042733 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] PATH_INFO: `/v3/projects/62288ae517b84ab1844817f46a5e546a` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.044089 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62288ae517b84ab1844817f46a5e546a)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.046046 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.157523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62288ae517b84ab1844817f46a5e546a', 'request_id': 'req-7076a703-742b-4cec-9880-d10767270915'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:54.226408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62288ae517b84ab1844817f46a5e546a', 'request_id': 'req-7076a703-742b-4cec-9880-d10767270915'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:54.235063 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62288ae517b84ab1844817f46a5e546a', 'request_id': 'req-7076a703-742b-4cec-9880-d10767270915'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:54.246289 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] The token cache is being invalidate because project 62288ae517b84ab1844817f46a5e546a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:37:54.250073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:54.250073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7076a703-742b-4cec-9880-d10767270915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:54.250073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1334/2643] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:54 2022] DELETE /identity/v3/projects/62288ae517b84ab1844817f46a5e546a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:54.254083 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.254561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.254654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.262799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:54.273648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:54.274858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:54.345371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1310/2644] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:54.357157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.357476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.357749 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.377247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:54.378470 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:54.387828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1335/2645] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:54.391448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.401231 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3fc18-ced3-4aff-8db7-d563c49120ff None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.409754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.410419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.410708 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.410991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.411723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:54.412037 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.413658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.425625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1311/2646] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:54.429849 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.439309 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab53221-3b75-423f-8754-b57cc2e25779 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.443978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.444775 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.445090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.445371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.446057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.448073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.542058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1336/2647] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:37:54 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:54.546713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.556910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63a68-2ca2-4b65-8534-2b5b8325ef39 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.614429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.615016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.615304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.615587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.616270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.618259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.717941 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1312/2648] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:37:54 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:37:54.721835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.732700 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06170f1-b3f5-488c-bf8b-5b0aeae220a0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.737295 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.737994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.738283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.738568 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.739288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.740916 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.752943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1337/2649] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:54.756803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.767502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1695-95a5-4f34-b833-9dc5e004e0c1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.772144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.772833 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.773126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.773411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.774140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.775766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbed72-057f-480b-87e9-45e8256a224f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.785588 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1313/2650] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:37:54.789513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:54.799414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9cbb-054e-4fa3-b45c-05b0faf052ef admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.804026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.804934 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.805216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.805489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] PATH_INFO: `/v3/projects/a9c9f88a1a51418fa4a7a5231ac8cb62/users/960a7d8f374c450b9ea2add666749e73/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.820863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c9f88a1a51418fa4a7a5231ac8cb62, user_id=960a7d8f374c450b9ea2add666749e73, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.823530 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.929433 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1338/2651] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:37:54 2022] PUT /identity/v3/projects/a9c9f88a1a51418fa4a7a5231ac8cb62/users/960a7d8f374c450b9ea2add666749e73/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:37:54.940330 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.940662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.940956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.975120 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] MFA Rules not processed for user `960a7d8f374c450b9ea2add666749e73`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:54.977038 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:55.056013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:55.059846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1314/2652] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:55.070662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:55.072298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:55.084024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:55.129970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212135a-c9ef-4003-a9c9-1e74667b4fc0 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:55.133600 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:55.134242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:55.134522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:55.134799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:55.143523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:55.145023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ded5a-498a-40e0-b8ff-8ad017e230ab service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:55.154193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1339/2653] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:58.989104 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:59.064825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac697-b452-4ae4-9565-6abdf4dae992 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:59.069292 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:59.070160 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:59.070442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:59.070718 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] PATH_INFO: `/v3/users/960a7d8f374c450b9ea2add666749e73` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:59.071880 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] RBAC: Authorizing `identity:delete_user(user_id=960a7d8f374c450b9ea2add666749e73)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:59.073872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:59.246510 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960a7d8f374c450b9ea2add666749e73'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:59.258306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960a7d8f374c450b9ea2add666749e73'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:59.258967 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960a7d8f374c450b9ea2add666749e73'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:59.259564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960a7d8f374c450b9ea2add666749e73'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:59.317411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960a7d8f374c450b9ea2add666749e73'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:37:59.330983 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1315/2654] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:37:58 2022] DELETE /identity/v3/users/960a7d8f374c450b9ea2add666749e73 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:37:59.335610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:59.336060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:59.336176 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:59.359469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:59.360809 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:59.418970 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1340/2655] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:37:59.428746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:59.430210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:59.489169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1bdb-5353-48d6-b6e0-91c89b7c757f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:59.492687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:59.493329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:59.493614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:59.493889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:59.503129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:59.504564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428eb0-b814-4856-bf81-9bafd5ac2937 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:59.514445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1316/2656] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:37:59.896238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:59.897698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:59.911051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3842-6d0c-4665-907c-2d0c77acad9b None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:59.915850 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:59.917536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:59.918217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:59.918217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] PATH_INFO: `/v3/projects/a9c9f88a1a51418fa4a7a5231ac8cb62` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:59.919616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c9f88a1a51418fa4a7a5231ac8cb62)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:59.922008 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.050613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c9f88a1a51418fa4a7a5231ac8cb62', 'request_id': 'req-e25165ce-6ca9-4d69-a3c8-cf000a569100'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:00.106890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c9f88a1a51418fa4a7a5231ac8cb62', 'request_id': 'req-e25165ce-6ca9-4d69-a3c8-cf000a569100'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:00.113489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c9f88a1a51418fa4a7a5231ac8cb62', 'request_id': 'req-e25165ce-6ca9-4d69-a3c8-cf000a569100'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:00.124906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] The token cache is being invalidate because project a9c9f88a1a51418fa4a7a5231ac8cb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:38:00.125196 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:00.125853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e25165ce-6ca9-4d69-a3c8-cf000a569100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:00.127424 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1341/2657] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:37:59 2022] DELETE /identity/v3/projects/a9c9f88a1a51418fa4a7a5231ac8cb62 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:00.132475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.132971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.133114 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.150331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:00.151518 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.168431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:00.210622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1317/2658] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:00.218830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.219127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.219443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.239455 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:00.240837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.250134 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1342/2659] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:00.254340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.264514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2154cd-0236-4970-bf2c-d66da1ef2a36 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.269354 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.270016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.270311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.270597 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.271324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:00.271643 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.273304 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.286348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1318/2660] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:00.290547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.300247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d8d0f-5cbf-40e0-938e-3f015d2dfa04 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.304944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.305529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.305810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.306088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.306767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.309417 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.395304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1343/2661] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:00.398018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.408046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf2d2-ccc1-4a2c-aaf1-37f6adc3557d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.463418 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.464094 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.464383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.465221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.466163 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.468118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.534942 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1319/2662] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:00.544686 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.555383 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151952e-e3a1-4766-b4c1-f23411c20954 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.560881 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.561547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.561837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.562114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.562841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.564440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.565817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:00.576121 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1344/2663] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:38:00.580405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.591476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145cad-024d-453d-baa6-59d496924749 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.596207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.596900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.597194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.597480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.598265 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.599871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386332d-3a73-4867-97c5-730350c05b10 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.610873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1320/2664] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:38:00.615023 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.625856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d64832-abdf-4046-88d7-6e154affd40f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.630492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.632783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.632783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.632783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] PATH_INFO: `/v3/projects/891becffe53d45c7b7f5ae36b0ec37d0/users/753f4626274c46d5a31a04ed3bf611c8/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.647160 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891becffe53d45c7b7f5ae36b0ec37d0, user_id=753f4626274c46d5a31a04ed3bf611c8, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.650216 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.735575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1345/2665] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:38:00 2022] PUT /identity/v3/projects/891becffe53d45c7b7f5ae36b0ec37d0/users/753f4626274c46d5a31a04ed3bf611c8/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:00.747211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.749959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.749959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.776273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] MFA Rules not processed for user `753f4626274c46d5a31a04ed3bf611c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:00.777625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.841369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1321/2666] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:00.852741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.854426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.911325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f11f8b-5281-4a87-b0ac-3888d986d037 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.915048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.915695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.915986 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.916273 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.925245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:00.926666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:00.935987 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1346/2667] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:38:10.838254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:10.931355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.933255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.934703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:30.010728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1469-de71-43eb-8072-78854df54a8c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.016829 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.017484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.017770 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.018046 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.019824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:30.031655 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.033383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba142-23e5-49d0-9d21-89f0e4d7360a service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.043480 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1322/2668] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:38:40.039195 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=32 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:54.478112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.544757 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6284c-f36a-413c-b479-3f9dd734be2f service glance] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:54.549914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:54.550795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.551078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.551352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] PATH_INFO: `/v3/users/753f4626274c46d5a31a04ed3bf611c8` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.552523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=753f4626274c46d5a31a04ed3bf611c8)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:54.554498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:54.690485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753f4626274c46d5a31a04ed3bf611c8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:54.691147 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753f4626274c46d5a31a04ed3bf611c8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:54.698169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753f4626274c46d5a31a04ed3bf611c8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:54.698919 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753f4626274c46d5a31a04ed3bf611c8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:54.739610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753f4626274c46d5a31a04ed3bf611c8'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:54.757359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1347/2669] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:38:54 2022] DELETE /identity/v3/users/753f4626274c46d5a31a04ed3bf611c8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:54.761902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.762384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.762484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.780178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:54.781407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:54.840620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1323/2670] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:54.851205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.852578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:54.910281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9c76-d28d-4695-b76a-3125401753fe admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:54.914024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:54.914666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.914948 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.915248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.924299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:54.925737 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827a64-5b4d-42b4-94e5-8ff1567f6b48 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:54.935159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1348/2671] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:38:55.307044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.308590 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:55.322945 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f49d-8fae-4ae9-ac4b-4fec17224b91 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.327652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.335190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.335190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.335190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] PATH_INFO: `/v3/projects/891becffe53d45c7b7f5ae36b0ec37d0` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.335190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891becffe53d45c7b7f5ae36b0ec37d0)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.335190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.443308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891becffe53d45c7b7f5ae36b0ec37d0', 'request_id': 'req-0e01ad12-52de-4432-890a-2189e8031526'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:55.449649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891becffe53d45c7b7f5ae36b0ec37d0', 'request_id': 'req-0e01ad12-52de-4432-890a-2189e8031526'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:55.455787 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891becffe53d45c7b7f5ae36b0ec37d0', 'request_id': 'req-0e01ad12-52de-4432-890a-2189e8031526'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:55.523230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] The token cache is being invalidate because project 891becffe53d45c7b7f5ae36b0ec37d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:38:55.523429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:55.524058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e01ad12-52de-4432-890a-2189e8031526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:55.525762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1324/2672] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:38:55 2022] DELETE /identity/v3/projects/891becffe53d45c7b7f5ae36b0ec37d0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:55.530889 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.531408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.531518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.558411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:55.559829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:55.579016 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.629165 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1349/2673] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:55.637251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.638036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.638036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.656869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:55.658685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:55.666555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1325/2674] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:55.670797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.681681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858c50d-754a-4016-af3c-2c99111efee2 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.686409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.687077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.687368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.687652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.688428 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:55.688939 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.690723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.702944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1350/2675] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:55.708101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.717595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba763059-28db-4fb6-be54-5cdf07fd9e10 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.722961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.723621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.723939 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.724245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.724973 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.726916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.787875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1326/2676] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:38:55 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:55.791893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.803064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a438d-5745-4cd0-8f23-457b538adcdb admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.859697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.860955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.861247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.861595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.862202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.864114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.934969 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1351/2677] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:38:55 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:55.939088 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.954212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723bcc-dd5a-4bf2-8697-97d1fa441f83 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.960705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.961422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.961712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.961993 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.962723 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.964334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.977068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1327/2678] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:38:55.981310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.992030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5bc1a-ef6c-4f45-af06-00e7ff752c70 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.996636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.997292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.997580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.997864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.998590 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.000175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8b55-513c-47dd-aff9-1d832036f164 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.010345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1352/2679] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:38:56.014258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.024564 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66011-8a2e-43fe-9c92-0946a660d0cd admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.029158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.030031 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.030317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.030596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] PATH_INFO: `/v3/projects/05fa9788797e4c17a14ef7e61b5bd220/users/d0509bbfc8f6400c8eb36c73cf53e388/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.046703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fa9788797e4c17a14ef7e61b5bd220, user_id=d0509bbfc8f6400c8eb36c73cf53e388, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.050175 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.100307 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1328/2680] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:38:56 2022] PUT /identity/v3/projects/05fa9788797e4c17a14ef7e61b5bd220/users/d0509bbfc8f6400c8eb36c73cf53e388/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:56.112778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.113076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.113363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.140529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] MFA Rules not processed for user `d0509bbfc8f6400c8eb36c73cf53e388`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:56.141805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:56.205291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1353/2681] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:56.216273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.217992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:56.244072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.282828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a6de-1d66-41be-a27b-c49cee6a1609 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.288444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.289131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.289416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.289697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.299032 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.300420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947c9c-60e9-442a-8b51-5be6df866f1c service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.309602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1329/2682] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:38:59.184580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:59.204400 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:59.254073 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778ac04-5c26-4969-bdc8-d070939f5c08 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:59.258726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:59.259635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.259913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.260188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] PATH_INFO: `/v3/users/d0509bbfc8f6400c8eb36c73cf53e388` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.261408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0509bbfc8f6400c8eb36c73cf53e388)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:59.263463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:59.439887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0509bbfc8f6400c8eb36c73cf53e388'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:59.440727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0509bbfc8f6400c8eb36c73cf53e388'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:59.447888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0509bbfc8f6400c8eb36c73cf53e388'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:59.448531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0509bbfc8f6400c8eb36c73cf53e388'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:59.522966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0509bbfc8f6400c8eb36c73cf53e388'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:38:59.541259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1354/2683] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:38:59 2022] DELETE /identity/v3/users/d0509bbfc8f6400c8eb36c73cf53e388 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:59.545910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.546383 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.546493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.565360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:59.566573 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:59.626070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1330/2684] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:38:59.635629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:59.637120 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:59.694665 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480b36-16cf-4f7c-b3c3-adb37198202e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:59.698758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:59.699437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.699824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.700111 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.709789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:59.711247 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1193c-a130-486c-8d4c-ba9f0c593d01 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:59.721672 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1355/2685] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:00.129828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.131333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:00.146808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf8e77-8896-4ab4-b536-f5494a068f78 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.152735 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.153609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.153891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.154148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] PATH_INFO: `/v3/projects/05fa9788797e4c17a14ef7e61b5bd220` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.155338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fa9788797e4c17a14ef7e61b5bd220)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.158441 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.295428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fa9788797e4c17a14ef7e61b5bd220', 'request_id': 'req-113d7867-cd48-4781-93ca-fc5fe2c80335'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:00.301653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fa9788797e4c17a14ef7e61b5bd220', 'request_id': 'req-113d7867-cd48-4781-93ca-fc5fe2c80335'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:00.307207 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fa9788797e4c17a14ef7e61b5bd220', 'request_id': 'req-113d7867-cd48-4781-93ca-fc5fe2c80335'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:00.408580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] The token cache is being invalidate because project 05fa9788797e4c17a14ef7e61b5bd220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:39:00.408904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:00.409542 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-113d7867-cd48-4781-93ca-fc5fe2c80335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:00.411107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1331/2686] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:39:00 2022] DELETE /identity/v3/projects/05fa9788797e4c17a14ef7e61b5bd220 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:00.415980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.416502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.416595 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.434843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:00.436116 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:00.469659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.494490 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1356/2687] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:39:00.503060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.503482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.503974 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.524123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:00.525377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:00.533476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1332/2688] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:39:00.539709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.549441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2f8e-8835-4a47-be3a-a0519e573c22 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.553901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.554557 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.554840 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.555119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.555843 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:00.556144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.557781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.569802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1357/2689] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:00.574034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.584545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2832e3-3a48-49ed-a13a-3d37b051226b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.589244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.589899 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.590188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.590471 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.591156 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.593179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.690614 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1333/2690] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:39:00 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:00.694918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.706298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631772-61cc-47ff-a5ec-027564cf0ad4 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.762072 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.762736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.763026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.763311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.764003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.765955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.843118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1358/2691] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:39:00 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:00.846961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.857784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a07a6-6853-4650-a72b-67d5dcfe2ee3 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.863271 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.863931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.864219 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.864502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.865270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.866874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.878342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1334/2692] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:00.882454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.893457 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3c30-dc8c-499b-9f0b-4e9643d4a464 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.898070 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.898724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.899014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.899305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.900031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.901659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e898d-e76e-4851-929c-2642ef67e3a2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.913548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1359/2693] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:00.917445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.927773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e3b6-dd66-4313-b089-c9f634b3456c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.932401 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.933327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.933616 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.933897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] PATH_INFO: `/v3/projects/ee5c5ad7e2d34027a12bb91ed87a7f19/users/dbfd103f83e147448bc11ab7bc5c4feb/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.936085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.948747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5c5ad7e2d34027a12bb91ed87a7f19, user_id=dbfd103f83e147448bc11ab7bc5c4feb, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.951462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.008182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1335/2694] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:39:00 2022] PUT /identity/v3/projects/ee5c5ad7e2d34027a12bb91ed87a7f19/users/dbfd103f83e147448bc11ab7bc5c4feb/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:39:01.013404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c037b0-33b3-4d07-9714-7cd245c051a6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.013697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c037b0-33b3-4d07-9714-7cd245c051a6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.013973 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c037b0-33b3-4d07-9714-7cd245c051a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.033532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-88c037b0-33b3-4d07-9714-7cd245c051a6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:01.034718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-88c037b0-33b3-4d07-9714-7cd245c051a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:01.092680 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1360/2695] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:39:01.102888 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.104575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:01.162233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701722-3c6b-4dfb-bf07-19c32f133ebc admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.165862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.166511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.166799 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.167081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.176893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.178328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.187672 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1336/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:06.336669 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.337171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.337171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.369498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] MFA Rules not processed for user `dbfd103f83e147448bc11ab7bc5c4feb`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:06.370727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:06.410091 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:06.442272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1361/2697] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:39:06.446841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.456759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb54f5-2740-491d-a9cc-f974a0166914 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.461527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.462196 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.462484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.462765 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.463604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.465475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.565275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1337/2698] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:39:06 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:06.569507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.580858 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f061b-1f22-4912-a0dc-79d6a39a5e07 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.650661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.650661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.650661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.650661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.651281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.657971 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.758294 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1362/2699] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:39:06 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:39:06.762262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.773780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17451-b1f9-4291-9900-7631c9d4093f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.778931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.784042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.784042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.784042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.784042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.784042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.795166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1338/2700] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:06.799913 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.812436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b267d-a4d0-4ad7-a56c-73a8cbdfa934 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.818000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.818900 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.819219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.819501 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] PATH_INFO: `/v3/projects/f2d5abc910644a619e8fc8921e55dd60/users/d793cdca454c4eba845b6c8e85ad87ec/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.839257 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d5abc910644a619e8fc8921e55dd60, user_id=d793cdca454c4eba845b6c8e85ad87ec, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.842079 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.913414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1363/2701] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:39:06 2022] PUT /identity/v3/projects/f2d5abc910644a619e8fc8921e55dd60/users/d793cdca454c4eba845b6c8e85ad87ec/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:06.917547 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.928689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01288974-f3ee-47ff-845f-adbb96ac7887 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.998653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.999366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.999662 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.999944 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.000714 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.002444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44008856-ff75-4b66-b953-0906d8f2fff9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.013249 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1339/2702] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:07.018007 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.028502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9026e7-140f-41e8-a20f-9eeb84fd3c71 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.033837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.034736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.035015 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.035310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] PATH_INFO: `/v3/projects/f2d5abc910644a619e8fc8921e55dd60/users/d793cdca454c4eba845b6c8e85ad87ec/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.037326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d5abc910644a619e8fc8921e55dd60, user_id=d793cdca454c4eba845b6c8e85ad87ec, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.039958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.052129 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1364/2703] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:39:07 2022] PUT /identity/v3/projects/f2d5abc910644a619e8fc8921e55dd60/users/d793cdca454c4eba845b6c8e85ad87ec/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:39:12.701025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542b3e-ad60-4b8e-96ae-37945e5caaf1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.701541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542b3e-ad60-4b8e-96ae-37945e5caaf1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.701621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542b3e-ad60-4b8e-96ae-37945e5caaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.733406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3a542b3e-ad60-4b8e-96ae-37945e5caaf1 None None] MFA Rules not processed for user `d793cdca454c4eba845b6c8e85ad87ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:12.734620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3a542b3e-ad60-4b8e-96ae-37945e5caaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:12.779233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.812042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1340/2704] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:39:12.828254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.830164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:12.910825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802f29-47c0-4c02-82d7-592bcb5321ee admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.916599 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.917351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.917703 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.918044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.945156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.980299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.982052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.993038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1365/2705] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:15.304070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.304731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.305005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.327113 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] MFA Rules not processed for user `dbfd103f83e147448bc11ab7bc5c4feb`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:15.328353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:15.348559 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1341/2706] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:39:23.014312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=16 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.319531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=15 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:41.315237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.316950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:41.374824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe22a3-cfdf-432f-b89d-798775ac0890 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.378589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.379152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.379435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.379708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.381461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:41.395269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.396760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.407578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1366/2707] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:41.701053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.756237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c5fa-4720-4c3c-8fb5-88a10871fa7e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.759685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.760333 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.760627 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.760925 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.762734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:41.773166 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.774587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.782528 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1342/2708] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:42.419174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.420596 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:42.492910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc97a-30ed-4121-9072-03e70b085b0f service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.497964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.498613 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.498901 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.499189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.500975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:42.512878 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.514492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.525892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1367/2709] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:51.778955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=26 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:52.521202 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=58 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:55.386891 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:55.388362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:55.399551 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee18a0-a5db-46e7-97a8-9d5bc1adc6a0 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:55.403472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:55.404162 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:55.404448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:55.404754 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:55.406575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:55.471025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:55.472677 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:55.482679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1343/2710] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:58.994938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:59.005626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d805-eaed-4d15-9680-2502ef2d3892 service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:59.010795 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:59.011518 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.011805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.012127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.017094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:59.029351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:59.031014 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:59.042838 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1368/2711] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:59.125574 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:59.127238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:59.141571 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616b7f3-17f3-4348-9592-c007a637c3f5 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:59.147262 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:59.148149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.148435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.148771 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] PATH_INFO: `/v3/users/2e88ad2e00984607a96a3e39d35e223d` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.150245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88ad2e00984607a96a3e39d35e223d)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:59.152990 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:59.153251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:59.155249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:59.172130 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76508f5-bb11-4723-a76e-5500306e3411 service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:59.178112 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:59.178769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.179058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.179336 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.181203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:59.194164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:59.195941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:59.206507 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1369/2712] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:39:59.380802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88ad2e00984607a96a3e39d35e223d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:59.393733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88ad2e00984607a96a3e39d35e223d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:59.395649 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88ad2e00984607a96a3e39d35e223d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:59.396286 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88ad2e00984607a96a3e39d35e223d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:59.483440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f372e584-805f-46e6-a577-7ac442e034ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88ad2e00984607a96a3e39d35e223d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:39:59.499687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1344/2713] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:39:59 2022] DELETE /identity/v3/users/2e88ad2e00984607a96a3e39d35e223d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:00.038195 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.049304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9790-fa82-4649-9e64-c799df6da305 service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.111033 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.111902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.112189 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.112461 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] PATH_INFO: `/v3/projects/6c28efed16244d2d9f43da4a441031a7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.114385 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c28efed16244d2d9f43da4a441031a7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.116316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.202543 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c28efed16244d2d9f43da4a441031a7', 'request_id': 'req-e510acd9-3921-427c-9a6c-ae6dec7e8190'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:00.259370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c28efed16244d2d9f43da4a441031a7', 'request_id': 'req-e510acd9-3921-427c-9a6c-ae6dec7e8190'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:00.266226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c28efed16244d2d9f43da4a441031a7', 'request_id': 'req-e510acd9-3921-427c-9a6c-ae6dec7e8190'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:00.277662 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] The token cache is being invalidate because project 6c28efed16244d2d9f43da4a441031a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:40:00.277953 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:00.278591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-e510acd9-3921-427c-9a6c-ae6dec7e8190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:00.280170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1370/2714] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:40:00 2022] DELETE /identity/v3/projects/6c28efed16244d2d9f43da4a441031a7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:00.286393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.286883 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.286977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.304153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:00.305389 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:00.364483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1345/2715] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:40:00.372481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.372888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.373206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.391893 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:00.393141 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:00.401830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1371/2716] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:40:00.405991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.415640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96de407-cb19-4ec6-b6a5-0de496827565 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.420070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.420752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.421039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.421314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.422034 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:00.422340 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.423932 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.426725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:00.437491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1346/2717] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:00.443902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.453405 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546664f8-5a47-4f3f-88c9-93558ec600a8 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.458839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.459497 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.459781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.460057 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.460779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.462666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.546856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1372/2718] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:40:00.551228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.561365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7df49-b396-4308-aab9-8330d1f936d1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.620499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.621193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.621487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.621802 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.622504 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.624421 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.739394 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1347/2719] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:40:00.743711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.754401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf18e-297f-42c4-b958-2e17a68bb9ce admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.759029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.759831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.760117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.760397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.761153 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.762774 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.774035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1373/2720] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:40:00.778136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.789380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b91c-4300-4eac-94d3-1590c33ec66d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.793988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.794642 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.794927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.795206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.795928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.797632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73c8d-5082-4db0-942a-50fabfdc3c7d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.807583 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1348/2721] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:40:00.811714 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.821817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4bc68-a121-48c2-89ed-aae152a49476 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.826368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.827237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.827522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.827802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] PATH_INFO: `/v3/projects/38b1749d45f142849ea395cbe1d124d6/users/42463697bf844d758b007d4d8939ca65/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.843883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b1749d45f142849ea395cbe1d124d6, user_id=42463697bf844d758b007d4d8939ca65, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.846569 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.912762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:00.917547 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1374/2722] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:40:00 2022] PUT /identity/v3/projects/38b1749d45f142849ea395cbe1d124d6/users/42463697bf844d758b007d4d8939ca65/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:00.928827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.929119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.929400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.955514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] MFA Rules not processed for user `42463697bf844d758b007d4d8939ca65`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:00.957386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:01.021981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1349/2723] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:40:01.026719 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.089214 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e3df-555c-4df6-8298-5b93e86ed02d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.093791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.094449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.094738 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.095021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.095721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.097940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.216883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1375/2724] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:40:01 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:40:01.220862 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.235646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7466-ce83-45ba-b072-e558fcfaa19a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.295613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.296300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.296589 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.297028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.297734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.299658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.307715 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:01.425806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1350/2725] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:40:01 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:40:01.429906 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.440144 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780d06-a4cf-47e3-871b-ef77b9f240ee admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.445570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.446232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.446522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.446801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.447529 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.449148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.460127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1376/2726] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:40:01.464302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.475362 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70087-5e86-4930-9ef4-1530e4f44268 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.480363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.481343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.481631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.481911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] PATH_INFO: `/v3/projects/c6ca9479b9144964b71c485e5a056d93/users/0ae552f8ad4046c5b703a170c473ab99/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.497525 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ca9479b9144964b71c485e5a056d93, user_id=0ae552f8ad4046c5b703a170c473ab99, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.500174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.556818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1351/2727] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:40:01 2022] PUT /identity/v3/projects/c6ca9479b9144964b71c485e5a056d93/users/0ae552f8ad4046c5b703a170c473ab99/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:01.560954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.571702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba8e71-9caa-4338-8a21-70270e738f0d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.629113 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.629778 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.630169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.630454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.631173 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.632780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7f288-f83b-49b6-96cd-6aa22226fa3a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.642572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1377/2728] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:40:01.647008 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.657451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e05634-5469-4827-b405-0c6ed64b3b2a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.662133 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.663018 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.663311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.663592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] PATH_INFO: `/v3/projects/c6ca9479b9144964b71c485e5a056d93/users/0ae552f8ad4046c5b703a170c473ab99/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.665654 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ca9479b9144964b71c485e5a056d93, user_id=0ae552f8ad4046c5b703a170c473ab99, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.668285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.679300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1352/2729] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:40:01 2022] PUT /identity/v3/projects/c6ca9479b9144964b71c485e5a056d93/users/0ae552f8ad4046c5b703a170c473ab99/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:01.689341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.689638 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.689923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.717476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] MFA Rules not processed for user `0ae552f8ad4046c5b703a170c473ab99`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:01.721702 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:01.779616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:01.789611 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1378/2730] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:40:01.801459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:01.803653 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:01.865646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babdefc-7a59-475a-90e0-4063a1bec62e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:01.869306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:01.869987 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:01.870274 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:01.870552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:01.879686 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:01.881107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:01.890495 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1353/2731] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:40:02.114370 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:02.124957 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a1b5f-41c8-46a4-b540-4a58324f9a55 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:02.129668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:02.130421 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:02.130655 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:02.130941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:02.195558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:02.197107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:02.207542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1379/2732] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:40:02.671598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:02.676326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:02.732000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18ed8-b47c-475e-a19d-c2ba9df7eca6 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:02.735563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:02.736203 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:02.736493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:02.736800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:02.739331 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:02.803442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:02.804951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:02.814914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1354/2733] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:40:04.989940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:04.991699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:05.070186 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9b32-8e5d-4248-854f-107cc523897b service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:05.075793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:05.076459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.076781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.077067 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.078979 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:05.092897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:05.094492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cc10c-193b-4e7e-a7cc-b3ca778ab9ef service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:05.106349 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1380/2734] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:40:12.810550 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:INSERT=4,keystone:SELECT=93 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:15.101261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=64 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:57.987313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:58.051874 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629386c-a508-4bbf-bc7a-4c10a6eb47c3 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:58.056416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:58.057350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:58.057639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:58.057917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] PATH_INFO: `/v3/users/42463697bf844d758b007d4d8939ca65` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:58.059103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42463697bf844d758b007d4d8939ca65)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:58.061091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:58.227153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42463697bf844d758b007d4d8939ca65'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:58.239978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42463697bf844d758b007d4d8939ca65'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:58.240751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42463697bf844d758b007d4d8939ca65'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:58.241358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42463697bf844d758b007d4d8939ca65'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:58.327515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42463697bf844d758b007d4d8939ca65'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:58.340555 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1355/2735] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:40:57 2022] DELETE /identity/v3/users/42463697bf844d758b007d4d8939ca65 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:58.345094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:58.345636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:58.345636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:58.363463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:58.364683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:58.423164 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1381/2736] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:40:58.433457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:58.434858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:58.492144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abdf05-f3a1-40b0-b58e-7e92bad2f686 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:58.495762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:58.496407 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:58.496727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:58.499959 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:58.507517 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:58.509194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:58.519254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1356/2737] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:40:58.884190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:58.889693 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:58.898489 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f65b0-6a42-4c17-b563-b590c16d1adf None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:58.904582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:58.905943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:58.906305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:58.906506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] PATH_INFO: `/v3/projects/38b1749d45f142849ea395cbe1d124d6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:58.908551 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b1749d45f142849ea395cbe1d124d6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:58.910992 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:59.014504 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b1749d45f142849ea395cbe1d124d6', 'request_id': 'req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.070127 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b1749d45f142849ea395cbe1d124d6', 'request_id': 'req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.076788 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b1749d45f142849ea395cbe1d124d6', 'request_id': 'req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.088019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] The token cache is being invalidate because project 38b1749d45f142849ea395cbe1d124d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:40:59.088312 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.088978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.090612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1382/2738] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:40:58 2022] DELETE /identity/v3/projects/38b1749d45f142849ea395cbe1d124d6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:59.094742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:59.108320 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e035fa7-0d75-4f71-be13-2c57b1b2aa96 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:59.127105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:59.165720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:59.166751 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:59.167332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:59.167841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] PATH_INFO: `/v3/users/0ae552f8ad4046c5b703a170c473ab99` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:59.169474 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae552f8ad4046c5b703a170c473ab99)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:59.171425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:59.348502 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae552f8ad4046c5b703a170c473ab99'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.360940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae552f8ad4046c5b703a170c473ab99'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.361634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae552f8ad4046c5b703a170c473ab99'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.363352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae552f8ad4046c5b703a170c473ab99'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.419193 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-94aae95e-7c92-4fb6-96f3-ef30f26fa23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae552f8ad4046c5b703a170c473ab99'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:40:59.433041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1357/2739] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:40:59 2022] DELETE /identity/v3/users/0ae552f8ad4046c5b703a170c473ab99 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:40:59.837728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:59.839199 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:59.853398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8b9-65f0-49de-9c7c-7ec608bf23a1 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:59.913707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:59.916552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:59.916552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:59.916552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] PATH_INFO: `/v3/projects/c6ca9479b9144964b71c485e5a056d93` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:59.916552 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ca9479b9144964b71c485e5a056d93)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:59.918200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:59.991977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:00.008972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ca9479b9144964b71c485e5a056d93', 'request_id': 'req-9609b2ac-aa14-470f-a5e6-863e015cfd37'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:00.083251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ca9479b9144964b71c485e5a056d93', 'request_id': 'req-9609b2ac-aa14-470f-a5e6-863e015cfd37'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:00.089821 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ca9479b9144964b71c485e5a056d93', 'request_id': 'req-9609b2ac-aa14-470f-a5e6-863e015cfd37'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:00.100299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] The token cache is being invalidate because project c6ca9479b9144964b71c485e5a056d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:00.100636 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:00.101343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9609b2ac-aa14-470f-a5e6-863e015cfd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:00.102946 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1383/2740] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:40:59 2022] DELETE /identity/v3/projects/c6ca9479b9144964b71c485e5a056d93 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:00.111724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.111724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.111724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.128647 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:00.133386 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:00.187795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1358/2741] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:00.196341 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d13-b205-49dd-b702-99d83473644c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.196657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d13-b205-49dd-b702-99d83473644c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.196944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d13-b205-49dd-b702-99d83473644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.217123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-bd702d13-b205-49dd-b702-99d83473644c None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:00.218467 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bd702d13-b205-49dd-b702-99d83473644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:00.226687 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1384/2742] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:00.231422 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.242483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28204e7-6c78-4255-b173-3b4455c381d1 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.247263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.247924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.248211 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.248491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.249253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:00.249569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.251174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.263115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1359/2743] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:41:00.267541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702d13-b205-49dd-b702-99d83473644c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.277366 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702d13-b205-49dd-b702-99d83473644c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.282042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.282688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.282978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.283260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.284625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.286587 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.357867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1385/2744] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:00.362295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.372379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb2830-998a-4e1a-900c-3b740067dfde admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.399115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:00.430387 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.431348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.431858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.432138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.432898 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.434864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.510904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1360/2745] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:00.514615 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.525525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457088e-c3e5-4395-b68c-e7ba39a55b8f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.530167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.530816 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.531101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.531376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.532097 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.534292 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.544832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1386/2746] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:00.548875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.559121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e8f94-810f-4633-9065-e16b4b18a9f8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.563946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.564625 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.565024 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.565311 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.566036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.567631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9abea-03aa-465b-ad07-9a0826bf0e47 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.577541 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1361/2747] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:00.582351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.592088 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972227fc-e14d-49f3-afa2-66a7bc475f1f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.597221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.598076 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.598354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.598626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] PATH_INFO: `/v3/projects/1f8244f3b57e48e1912d6a15a8d8b509/users/0490ba1be0884372a294af25067f0a39/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.613051 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8244f3b57e48e1912d6a15a8d8b509, user_id=0490ba1be0884372a294af25067f0a39, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.615675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.664491 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1387/2748] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:00 2022] PUT /identity/v3/projects/1f8244f3b57e48e1912d6a15a8d8b509/users/0490ba1be0884372a294af25067f0a39/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:41:00.680316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.680633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.680936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.713911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] MFA Rules not processed for user `0490ba1be0884372a294af25067f0a39`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:00.715143 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:00.782926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1362/2749] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:00.787857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.848449 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ce3e9-c72a-4956-a7f5-321e8747f98d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.853117 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.853763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.854307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.854584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.855265 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.857158 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:00.922721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1388/2750] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:00.926972 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:00.937533 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680762-95fe-40db-8ab2-f0d769f62914 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:00.995688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:00.996364 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:00.996682 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:00.996970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:00.997661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:00.999586 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.060344 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1363/2751] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:00 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:01.065769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.079291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058f5e-7c35-4ecd-9d9c-3f7e7c8afa52 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.084875 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.085542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.085831 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.086159 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.086884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.088479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.099833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1389/2752] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:01.104426 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.115069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f45c9-2794-4f8f-bb49-3523840bc9ab admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.119634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.120295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.120580 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.120893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.121648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.123279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfea97c-18a0-492d-91a2-07dd866f235e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.134346 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1364/2753] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:01.138666 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.149955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a870e-76fc-418c-ba7a-89b81567a5b7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.154661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.155536 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.155823 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.156102 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] PATH_INFO: `/v3/projects/17810279bc2f48989de4529ba996b0a1/users/68ee03379c20403e82eeecee1567b7ce/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.171060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=17810279bc2f48989de4529ba996b0a1, user_id=68ee03379c20403e82eeecee1567b7ce, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.173910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.301056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:01.305890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1390/2754] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:01 2022] PUT /identity/v3/projects/17810279bc2f48989de4529ba996b0a1/users/68ee03379c20403e82eeecee1567b7ce/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:41:01.367103 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.367316 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.367593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.395981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] MFA Rules not processed for user `68ee03379c20403e82eeecee1567b7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:01.397224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:01.401291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:01.461527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1365/2755] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:01.465997 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.527337 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e25810-b4aa-42f6-9619-b51d061177fe admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.531923 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.532577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.532894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.533175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.533885 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.535853 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.644542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1391/2756] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:01.648129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.659042 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952af1-aae7-40ae-a275-065b80789068 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.714977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.715658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.715937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.716220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.716971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.718887 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.790947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1366/2757] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:01 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:01.794944 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.806170 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408ec-98c7-4f0f-9120-2ea8afa8b775 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.810835 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.817242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.817242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.817242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.817242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.817242 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.825510 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1392/2758] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:01.829639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.839747 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e64e8-d9df-45d8-87ea-2fa3012096f0 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:01.844444 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:01.845911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:01.845911 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:01.846078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] PATH_INFO: `/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385/users/343dccb03ccc4a98ae362dd01cdabc9f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:01.861482 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ad616fa1ef4e19b194dcc05e5c1385, user_id=343dccb03ccc4a98ae362dd01cdabc9f, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:01.865326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:01.934235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1367/2759] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:01 2022] PUT /identity/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385/users/343dccb03ccc4a98ae362dd01cdabc9f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:01.938194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:01.948325 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6a1c-5d53-49a0-a999-19c96484ab80 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:02.007736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:02.008447 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:02.008772 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:02.009056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:02.009783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:02.011373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54be066-7e24-41c6-831e-2d92874ed22b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:02.021342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1393/2760] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:02.025534 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:02.035789 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bb9d5-c21b-4959-8881-98b6789e843c admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:02.040410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:02.041332 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:02.041620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:02.041902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] PATH_INFO: `/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385/users/343dccb03ccc4a98ae362dd01cdabc9f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:02.043864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ad616fa1ef4e19b194dcc05e5c1385, user_id=343dccb03ccc4a98ae362dd01cdabc9f, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:02.046521 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:02.057191 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1368/2761] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:02 2022] PUT /identity/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385/users/343dccb03ccc4a98ae362dd01cdabc9f/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:02.067905 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:02.068205 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:02.068495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:02.094553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] MFA Rules not processed for user `343dccb03ccc4a98ae362dd01cdabc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:02.095764 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:02.154741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:02.164391 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1394/2762] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:02.176293 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:02.178338 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:02.239385 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c941afa-ae52-4580-bf99-9682b5fbb591 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:02.243047 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:02.243701 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:02.243989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:02.244277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:02.254001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:02.255451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:02.260378 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:02.265085 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1369/2763] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:03.151918 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:03.153365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:03.166285 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddda9-debf-4dee-b2c3-27036ca45705 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:03.169994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:03.170644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:03.170962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:03.171248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:03.227924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:03.229677 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:03.241397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1395/2764] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:09.055975 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:09.064868 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a06df-c5b2-43be-8cf9-6d9bdd9c1634 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:09.069242 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:09.069878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:09.070168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:09.070448 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:09.127698 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:09.129707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5bdd-a9b3-436f-b23b-bcafad11666d service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:09.138673 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1370/2765] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:12.902727 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:12.966882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54db52-f2ad-47e3-9dfe-170d148bb221 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:12.971420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:12.972975 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:12.973274 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:12.973558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] PATH_INFO: `/v3/users/0490ba1be0884372a294af25067f0a39` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:12.975053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0490ba1be0884372a294af25067f0a39)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:12.977013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:13.175753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0490ba1be0884372a294af25067f0a39'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:13.176419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0490ba1be0884372a294af25067f0a39'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:13.183678 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0490ba1be0884372a294af25067f0a39'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:13.184300 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0490ba1be0884372a294af25067f0a39'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:13.241668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0490ba1be0884372a294af25067f0a39'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:13.261479 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1396/2766] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:12 2022] DELETE /identity/v3/users/0490ba1be0884372a294af25067f0a39 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:13.266173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:13.266666 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:13.266773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:13.284007 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:13.285449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:13.344411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1371/2767] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:13.354977 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:13.356500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:13.371820 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:13.415154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8c10-446e-43e8-8d84-6d616c2efebe admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:13.418860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:13.419517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:13.419803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:13.420083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:13.429985 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:13.431492 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:13.441279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1397/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:13.860270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:13.861752 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:13.876763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9148975-b3c7-416a-b9dc-9b34bc3e331b None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:13.882960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:13.883962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:13.884254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:13.884535 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] PATH_INFO: `/v3/projects/1f8244f3b57e48e1912d6a15a8d8b509` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:13.885786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8244f3b57e48e1912d6a15a8d8b509)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:13.887763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:14.020420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8244f3b57e48e1912d6a15a8d8b509', 'request_id': 'req-a346d26a-14f7-4c56-813c-4c5d4d3c074d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.026572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8244f3b57e48e1912d6a15a8d8b509', 'request_id': 'req-a346d26a-14f7-4c56-813c-4c5d4d3c074d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.032183 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8244f3b57e48e1912d6a15a8d8b509', 'request_id': 'req-a346d26a-14f7-4c56-813c-4c5d4d3c074d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.115516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] The token cache is being invalidate because project 1f8244f3b57e48e1912d6a15a8d8b509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:14.115806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.116442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.118014 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1372/2769] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:13 2022] DELETE /identity/v3/projects/1f8244f3b57e48e1912d6a15a8d8b509 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:14.122044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:14.132589 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c04167-b899-4164-a6cd-b055671a830f service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:14.187857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:14.188780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:14.189060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:14.189342 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] PATH_INFO: `/v3/users/68ee03379c20403e82eeecee1567b7ce` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:14.190535 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ee03379c20403e82eeecee1567b7ce)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:14.193182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:14.369388 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ee03379c20403e82eeecee1567b7ce'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.369972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ee03379c20403e82eeecee1567b7ce'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.376839 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ee03379c20403e82eeecee1567b7ce'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.377617 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ee03379c20403e82eeecee1567b7ce'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.447024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ee03379c20403e82eeecee1567b7ce'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:14.466044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1398/2770] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:14 2022] DELETE /identity/v3/users/68ee03379c20403e82eeecee1567b7ce => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:14.843013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:14.844473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:14.858402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d26a-14f7-4c56-813c-4c5d4d3c074d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:14.877836 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:14.917067 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:14.917858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:14.918150 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:14.918462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] PATH_INFO: `/v3/projects/17810279bc2f48989de4529ba996b0a1` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:14.919650 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17810279bc2f48989de4529ba996b0a1)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:14.921652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:15.007848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17810279bc2f48989de4529ba996b0a1', 'request_id': 'req-50007aa8-3658-458f-9de7-70045940fee1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.013895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17810279bc2f48989de4529ba996b0a1', 'request_id': 'req-50007aa8-3658-458f-9de7-70045940fee1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.019366 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17810279bc2f48989de4529ba996b0a1', 'request_id': 'req-50007aa8-3658-458f-9de7-70045940fee1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.069457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] The token cache is being invalidate because project 17810279bc2f48989de4529ba996b0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:15.069740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.070369 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.071981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1373/2771] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:14 2022] DELETE /identity/v3/projects/17810279bc2f48989de4529ba996b0a1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:15.076025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:15.077440 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:15.090321 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c5a2-8702-4cef-8fc1-4666742fb0bd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:15.124192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:15.147754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:15.149198 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:15.149480 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:15.149783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] PATH_INFO: `/v3/users/343dccb03ccc4a98ae362dd01cdabc9f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:15.150949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343dccb03ccc4a98ae362dd01cdabc9f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:15.152891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:15.359867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343dccb03ccc4a98ae362dd01cdabc9f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.360533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343dccb03ccc4a98ae362dd01cdabc9f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.368830 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343dccb03ccc4a98ae362dd01cdabc9f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.369486 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343dccb03ccc4a98ae362dd01cdabc9f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.459355 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-38e28f27-8680-4f15-99ca-9c8de38f2691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343dccb03ccc4a98ae362dd01cdabc9f'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:15.478747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1399/2772] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:15 2022] DELETE /identity/v3/users/343dccb03ccc4a98ae362dd01cdabc9f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:15.888659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:15.890131 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:15.903345 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007aa8-3658-458f-9de7-70045940fee1 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:15.963602 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:15.964473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:15.964791 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:15.965069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] PATH_INFO: `/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:15.966239 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ad616fa1ef4e19b194dcc05e5c1385)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:15.968182 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.087342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ad616fa1ef4e19b194dcc05e5c1385', 'request_id': 'req-8a4a25cf-0844-447f-a003-d8e6576126a4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:16.093319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ad616fa1ef4e19b194dcc05e5c1385', 'request_id': 'req-8a4a25cf-0844-447f-a003-d8e6576126a4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:16.094496 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:16.099348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ad616fa1ef4e19b194dcc05e5c1385', 'request_id': 'req-8a4a25cf-0844-447f-a003-d8e6576126a4'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:16.264341 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] The token cache is being invalidate because project 48ad616fa1ef4e19b194dcc05e5c1385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:16.264668 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:16.265301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8a4a25cf-0844-447f-a003-d8e6576126a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:16.266871 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1374/2773] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:15 2022] DELETE /identity/v3/projects/48ad616fa1ef4e19b194dcc05e5c1385 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:16.274194 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.274730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.274829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.293832 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:16.295030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:16.355026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1400/2774] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:16.364484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.364808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.365099 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.384009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:16.385258 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:16.393111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1375/2775] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:16.398119 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.407910 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3eec-8bcf-4102-9f43-59ecd5274bfd None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.412813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.413475 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.413767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.414052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.414782 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:16.415096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.416730 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.428933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1401/2776] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:16.433148 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.443608 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0561ee-e031-457c-9b3b-0812bc0cb71d None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.448927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.449584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.449876 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.450158 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.450855 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.452803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.579814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1376/2777] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:16 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:16.584411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.594460 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e784-e879-405f-a19f-4062a3b5736b admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.642914 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:16.665482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.666422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.666717 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.667010 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.667715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.669771 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.745339 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1402/2778] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:16 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:16.749513 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.775429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7078aaa-dcfc-46f2-be8c-f4635df802e7 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.780123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.784509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.784509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.784509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.784509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.784509 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.794707 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1377/2779] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:16.798842 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.826245 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77785-9ecc-49f6-a5fa-a32be3bc1dbd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.830877 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.832041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.832328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.832627 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.833374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.834960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f568b-8985-440c-8272-6ec7fe028e55 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.844573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1403/2780] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:41:16.849488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:16.863240 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035801-3620-4014-8f9d-10589feea4f2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:16.868013 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:16.868924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.869212 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.869488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] PATH_INFO: `/v3/projects/51d60752c1224b2080cb500fc491e704/users/14045aba1f5d4142ae1b4e20851040ad/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.883900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d60752c1224b2080cb500fc491e704, user_id=14045aba1f5d4142ae1b4e20851040ad, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:16.886594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:16.933076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1378/2781] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:16 2022] PUT /identity/v3/projects/51d60752c1224b2080cb500fc491e704/users/14045aba1f5d4142ae1b4e20851040ad/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:16.945251 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:16.945776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:16.946310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:16.991083 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] MFA Rules not processed for user `14045aba1f5d4142ae1b4e20851040ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:16.997013 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:17.058353 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1404/2782] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:17.062980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.124229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2303-1ee7-42cd-9e86-64d63713af57 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.129516 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.130171 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.130456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.130733 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.131460 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.133399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.198040 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1379/2783] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:17 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:17.202126 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.213753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7ef6b-1c13-4cfc-920f-80c405b1e954 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.272846 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.273532 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.273825 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.274139 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.274834 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.276793 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.357306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1405/2784] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:17 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:17.361221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.372054 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39f31-e3e2-4b6c-a46c-8325f7c7972e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.379566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.379566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.379566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.379566 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.379927 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.380858 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.391438 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1380/2785] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:17.402629 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.406637 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c8d07-12a7-46d8-9af1-0deda2ce3449 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.411698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.412794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.413080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.413361 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] PATH_INFO: `/v3/projects/2fd940a11aff497694e8708688ae1aa9/users/691d0bc758584a6cb2eb965e2ad7f901/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.426347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:17.430512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd940a11aff497694e8708688ae1aa9, user_id=691d0bc758584a6cb2eb965e2ad7f901, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.433203 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.505740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1406/2786] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:17 2022] PUT /identity/v3/projects/2fd940a11aff497694e8708688ae1aa9/users/691d0bc758584a6cb2eb965e2ad7f901/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:17.509762 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.520935 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116434-cf4b-414a-a194-522516fc5305 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.553045 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:17.576295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.576992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.577278 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.577632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.578358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.579940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5bb40-b31b-4891-b1c9-bbc1cda2eb25 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.590828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1381/2787] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:17.597659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.610459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e0a1-89d1-44f1-b556-4be64fbaf831 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.616412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.617435 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.623459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.623459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] PATH_INFO: `/v3/projects/2fd940a11aff497694e8708688ae1aa9/users/691d0bc758584a6cb2eb965e2ad7f901/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.623459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd940a11aff497694e8708688ae1aa9, user_id=691d0bc758584a6cb2eb965e2ad7f901, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.623459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.634237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1407/2788] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:17 2022] PUT /identity/v3/projects/2fd940a11aff497694e8708688ae1aa9/users/691d0bc758584a6cb2eb965e2ad7f901/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:17.646053 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.646353 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.646638 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.673358 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] MFA Rules not processed for user `691d0bc758584a6cb2eb965e2ad7f901`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:17.674558 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:17.742270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1382/2789] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:17.753232 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:17.755396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:17.820675 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69242b-57ee-4d21-b8c3-31c2f29ae2cf admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:17.824282 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:17.824956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:17.825248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:17.825531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:17.835575 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:17.837055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:17.846409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1408/2790] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:18.041943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:18.052339 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662cf41-2de9-481d-bc2b-f22bab41f43a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:18.055952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:18.056596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:18.056943 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:18.057214 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:18.114687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:18.116056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945688eb-222a-459f-89e6-6567bafa9409 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:18.124971 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1383/2791] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:23.980792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:24.042890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69f327-00f3-47a7-b80f-5eb5b89bea8b service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:24.047513 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:24.048395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:24.048792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:24.049094 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] PATH_INFO: `/v3/users/14045aba1f5d4142ae1b4e20851040ad` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:24.050281 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14045aba1f5d4142ae1b4e20851040ad)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:24.052338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:24.262663 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14045aba1f5d4142ae1b4e20851040ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:24.263397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14045aba1f5d4142ae1b4e20851040ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:24.270652 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14045aba1f5d4142ae1b4e20851040ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:24.271286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14045aba1f5d4142ae1b4e20851040ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:24.316208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14045aba1f5d4142ae1b4e20851040ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:24.325626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:24.335657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1409/2792] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:23 2022] DELETE /identity/v3/users/14045aba1f5d4142ae1b4e20851040ad => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:24.340892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919784d-47d0-495b-a028-85091dcae81e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:24.341371 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919784d-47d0-495b-a028-85091dcae81e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:24.341591 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919784d-47d0-495b-a028-85091dcae81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:24.359243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0919784d-47d0-495b-a028-85091dcae81e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:24.369811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0919784d-47d0-495b-a028-85091dcae81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:24.409689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=100 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:24.421667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1384/2793] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:24.431787 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:24.433264 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:24.500710 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12ef31-cfc2-4666-aaa6-b13d51bd16a5 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:24.504883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:24.505695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:24.505981 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:24.506262 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:24.515231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:24.516692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:24.527670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1410/2794] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:24.905970 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919784d-47d0-495b-a028-85091dcae81e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:24.907481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0919784d-47d0-495b-a028-85091dcae81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:24.920487 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919784d-47d0-495b-a028-85091dcae81e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:24.925125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:24.926687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:24.926980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:24.927298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] PATH_INFO: `/v3/projects/51d60752c1224b2080cb500fc491e704` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:24.928484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d60752c1224b2080cb500fc491e704)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:24.932476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:25.013472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d60752c1224b2080cb500fc491e704', 'request_id': 'req-3cd0f6db-3b2f-4bad-916a-52edd960615e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.019461 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d60752c1224b2080cb500fc491e704', 'request_id': 'req-3cd0f6db-3b2f-4bad-916a-52edd960615e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.025427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d60752c1224b2080cb500fc491e704', 'request_id': 'req-3cd0f6db-3b2f-4bad-916a-52edd960615e'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.074670 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] The token cache is being invalidate because project 51d60752c1224b2080cb500fc491e704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:25.074949 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.075656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.077280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1385/2795] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:24 2022] DELETE /identity/v3/projects/51d60752c1224b2080cb500fc491e704 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:25.083003 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:25.091525 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a396-c64d-430f-b2e4-475a2b30bf17 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:25.148053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:25.148954 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:25.149238 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:25.149515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] PATH_INFO: `/v3/users/691d0bc758584a6cb2eb965e2ad7f901` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:25.150724 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] RBAC: Authorizing `identity:delete_user(user_id=691d0bc758584a6cb2eb965e2ad7f901)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:25.152650 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:25.348211 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691d0bc758584a6cb2eb965e2ad7f901'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.348890 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691d0bc758584a6cb2eb965e2ad7f901'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.356030 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691d0bc758584a6cb2eb965e2ad7f901'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.356688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691d0bc758584a6cb2eb965e2ad7f901'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.447369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-c1660d32-e33a-455b-85ea-38d56aa595af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691d0bc758584a6cb2eb965e2ad7f901'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:25.465544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1411/2796] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:25 2022] DELETE /identity/v3/users/691d0bc758584a6cb2eb965e2ad7f901 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:25.866244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:25.867767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:25.882001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0f6db-3b2f-4bad-916a-52edd960615e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:25.941843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:25.942784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:25.943074 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:25.943380 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] PATH_INFO: `/v3/projects/2fd940a11aff497694e8708688ae1aa9` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:25.944731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd940a11aff497694e8708688ae1aa9)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:25.946989 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.070488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd940a11aff497694e8708688ae1aa9', 'request_id': 'req-24114b86-b870-42b2-81a3-2c9438434e61'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:26.076592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd940a11aff497694e8708688ae1aa9', 'request_id': 'req-24114b86-b870-42b2-81a3-2c9438434e61'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:26.082678 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd940a11aff497694e8708688ae1aa9', 'request_id': 'req-24114b86-b870-42b2-81a3-2c9438434e61'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:26.155503 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] The token cache is being invalidate because project 2fd940a11aff497694e8708688ae1aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:26.155721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:26.156328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-24114b86-b870-42b2-81a3-2c9438434e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:26.157928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1386/2797] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:25 2022] DELETE /identity/v3/projects/2fd940a11aff497694e8708688ae1aa9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:26.163040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.163531 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.163635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.170769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:26.181564 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:26.182767 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:26.243118 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1412/2798] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:26.251252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.251545 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.256743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.270857 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:26.272058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:26.280001 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1387/2799] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:26.295856 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.307444 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766a9ac-1e8d-4e86-b1db-7ab30cf957a5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.312035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.312725 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.313018 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.313301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.314031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:26.314345 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.315942 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.333155 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1413/2800] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:26.337758 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.342282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:26.347537 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b9e7-d499-45a1-9780-a1c79aa12e23 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.352878 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.353556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.354096 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.354404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.355093 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.357019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.415465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1388/2801] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:26.419438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.430671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d5a-1eec-4a5d-81f8-c906e0c37783 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.486392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.487034 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.487319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.487597 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.488431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.490352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.567799 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1414/2802] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:26.572123 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.583540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827888db-3f39-43e4-b28c-a63376db74a2 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.588209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.588908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.589201 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.589484 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.590213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.591817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.602780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1389/2803] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:26.611645 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.621988 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e814b-6cba-4592-934a-9f7712f120d3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.626567 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.627220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.627511 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.627791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.628521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.630241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146ef7-75b0-42cc-838f-7150310a2731 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.641932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1415/2804] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:26.646689 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.656805 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4528-34eb-4fcc-903a-f913bafdce47 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.662424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.663302 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.663594 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.663872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] PATH_INFO: `/v3/projects/a5b34427aca7400c9f5295bba59c874e/users/8b4110121b0c458688bf3d3f424be3c5/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.680306 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b34427aca7400c9f5295bba59c874e, user_id=8b4110121b0c458688bf3d3f424be3c5, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.682993 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:26.750188 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1390/2805] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:26 2022] PUT /identity/v3/projects/a5b34427aca7400c9f5295bba59c874e/users/8b4110121b0c458688bf3d3f424be3c5/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:26.761515 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.761808 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.762095 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.790454 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] MFA Rules not processed for user `8b4110121b0c458688bf3d3f424be3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:26.791706 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:26.851814 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:26.855634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1416/2806] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:26.860115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:26.922978 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4794ca-fdc5-45fb-bb92-2a0d6e5460ec admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:26.928285 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:26.928981 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:26.929273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:26.929556 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:26.930260 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:26.932224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.025769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1391/2807] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:26 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:27.029833 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.041223 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e340-1240-4488-a4d1-70eeb7e9d7d4 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.095805 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.096466 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.096794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.097078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.098303 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.100291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.208800 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1417/2808] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:27 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:27.212727 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.224282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded04d-8db2-48d8-8dab-a66ac9baa95d admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.229446 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.230111 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.230416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.230692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.231427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.233056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.244347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1392/2809] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:27.248495 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.258781 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddbe9-28e1-46bb-be09-6ec5bed69426 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.263445 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.264107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.264398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.264728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.265459 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.267049 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870b70-fa96-48fd-9012-ba4e0a4626ea admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.277924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1418/2810] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:41:27.281960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.292873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08547d-7660-4e69-adfc-db271a021c5e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.297595 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.298526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.298842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.299153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] PATH_INFO: `/v3/projects/b9ee1f0ec9db49d7aa043d61144a127b/users/897cdf1dbda0485881ce83cf42821835/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.313449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ee1f0ec9db49d7aa043d61144a127b, user_id=897cdf1dbda0485881ce83cf42821835, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.316106 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.380263 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1393/2811] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:27 2022] PUT /identity/v3/projects/b9ee1f0ec9db49d7aa043d61144a127b/users/897cdf1dbda0485881ce83cf42821835/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:27.391463 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.391851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.392138 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.420664 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] MFA Rules not processed for user `897cdf1dbda0485881ce83cf42821835`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:27.421870 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:27.490371 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1419/2812] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:27.494852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.552139 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:27.557144 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84b2e-86d9-443c-b206-a43f54894849 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.561746 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.565390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.565390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.565390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.565390 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.565724 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.677127 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1394/2813] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:27 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:27.681277 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.693451 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005289-3321-46d2-afda-77683b5f2e1f None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.767021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.767603 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.767892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.768175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.769210 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.772896 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.871125 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:27.878031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1420/2814] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:27 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:27.882107 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.893431 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928e0a0-e665-4b19-9959-d2d2d7f70270 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.899105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.899769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.900062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.900347 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.901118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.902729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:27.913615 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1395/2815] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:27.917804 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:27.927758 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58cf02-d767-4b04-85ac-6d2c5e4aa0f2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:27.932558 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:27.933701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:27.934358 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:27.935078 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] PATH_INFO: `/v3/projects/b9732351322047e4a25fa9643ca8d463/users/cfda3a1d37594730b09eaf10e00162e1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:27.950338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9732351322047e4a25fa9643ca8d463, user_id=cfda3a1d37594730b09eaf10e00162e1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:27.953061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:28.030275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1421/2816] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:27 2022] PUT /identity/v3/projects/b9732351322047e4a25fa9643ca8d463/users/cfda3a1d37594730b09eaf10e00162e1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:28.034252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:28.045492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ab013-53ea-4e32-ac55-d9092af4fee8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:28.104684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:28.105350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:28.105646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:28.105924 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:28.106658 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:28.108259 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4712f-2195-427b-95e3-b038bc62aa76 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:28.118410 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1396/2817] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:28.122619 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:28.132868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd845e75-a2d8-44c2-a0d7-e33d55e71f53 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:28.137496 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:28.138377 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:28.138661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:28.138937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] PATH_INFO: `/v3/projects/b9732351322047e4a25fa9643ca8d463/users/cfda3a1d37594730b09eaf10e00162e1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:28.140895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9732351322047e4a25fa9643ca8d463, user_id=cfda3a1d37594730b09eaf10e00162e1, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:28.143512 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:28.155484 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1422/2818] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:28 2022] PUT /identity/v3/projects/b9732351322047e4a25fa9643ca8d463/users/cfda3a1d37594730b09eaf10e00162e1/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:28.166348 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:28.166644 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:28.166928 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:28.193117 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] MFA Rules not processed for user `cfda3a1d37594730b09eaf10e00162e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:28.194324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:28.263153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1397/2819] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:28.274955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:28.276736 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:28.333616 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe03b8-0a6b-46a0-b74f-9ca84839f331 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:28.337537 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:28.338208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:28.338498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:28.338783 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:28.347940 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:28.349410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:28.359052 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1423/2820] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:28.469424 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:28.470842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:28.483661 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026eb7-82e4-483b-aea0-e4201b3eed6c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:28.487283 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:28.487929 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:28.488869 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:28.489251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:28.536848 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:28.546553 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:28.548363 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:28.559125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1398/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:29.653077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:29.654639 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:29.719579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ffb1d-cb8c-4fe4-b0f3-5fbfb33424ad service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:29.724035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:29.724732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:29.725038 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:29.725307 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:29.727131 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:29.737477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:29.739031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786153b6-97b6-4be2-9bdc-3b23a2463932 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:29.747419 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1424/2822] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:33.501641 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:33.565810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe605a0-ecba-4e86-a57d-9fa181938fb2 service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:33.571221 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:33.572089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.572377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.572684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] PATH_INFO: `/v3/users/8b4110121b0c458688bf3d3f424be3c5` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.573864 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4110121b0c458688bf3d3f424be3c5)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:33.575783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:33.730909 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4110121b0c458688bf3d3f424be3c5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:33.742623 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4110121b0c458688bf3d3f424be3c5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:33.743335 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4110121b0c458688bf3d3f424be3c5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:33.743885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4110121b0c458688bf3d3f424be3c5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:33.795408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4110121b0c458688bf3d3f424be3c5'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:33.807952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1399/2823] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:33 2022] DELETE /identity/v3/users/8b4110121b0c458688bf3d3f424be3c5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:33.812813 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.813306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.813306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.831549 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:33.833527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:33.891258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1425/2824] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:33.902179 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:33.903582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:33.961284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec103f0-4389-4971-812d-2de4b5c542ee admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:33.965000 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:33.965659 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.965946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.966230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.975459 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:33.976937 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:33.986543 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1400/2825] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:34.391712 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:34.393191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:34.405972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7374-da0d-4640-8521-555d0948c9bb None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:34.411201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:34.412573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:34.412894 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:34.413178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] PATH_INFO: `/v3/projects/a5b34427aca7400c9f5295bba59c874e` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:34.414426 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b34427aca7400c9f5295bba59c874e)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:34.416332 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:34.418174 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:34.509673 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b34427aca7400c9f5295bba59c874e', 'request_id': 'req-05670b9e-54d7-421c-bdc7-05efb36763f2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.572883 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b34427aca7400c9f5295bba59c874e', 'request_id': 'req-05670b9e-54d7-421c-bdc7-05efb36763f2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.579522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b34427aca7400c9f5295bba59c874e', 'request_id': 'req-05670b9e-54d7-421c-bdc7-05efb36763f2'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.590152 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] The token cache is being invalidate because project a5b34427aca7400c9f5295bba59c874e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:34.590471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.591241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.592867 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1426/2826] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:34 2022] DELETE /identity/v3/projects/a5b34427aca7400c9f5295bba59c874e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:34.596830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:34.607680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186826e-b2ec-4488-9c53-aac5b2d41504 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:34.615992 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:34.663680 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:34.664548 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:34.664861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:34.665138 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] PATH_INFO: `/v3/users/897cdf1dbda0485881ce83cf42821835` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:34.666323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897cdf1dbda0485881ce83cf42821835)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:34.668237 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:34.821076 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897cdf1dbda0485881ce83cf42821835'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.834070 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897cdf1dbda0485881ce83cf42821835'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.834683 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897cdf1dbda0485881ce83cf42821835'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.835328 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897cdf1dbda0485881ce83cf42821835'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.887334 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897cdf1dbda0485881ce83cf42821835'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:34.901458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1401/2827] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:34 2022] DELETE /identity/v3/users/897cdf1dbda0485881ce83cf42821835 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:35.329253 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:35.330817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:35.345329 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05670b9e-54d7-421c-bdc7-05efb36763f2 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:35.406443 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:35.409077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:35.409077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:35.409077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] PATH_INFO: `/v3/projects/b9ee1f0ec9db49d7aa043d61144a127b` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:35.409354 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ee1f0ec9db49d7aa043d61144a127b)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:35.411077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:35.527169 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ee1f0ec9db49d7aa043d61144a127b', 'request_id': 'req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.584441 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ee1f0ec9db49d7aa043d61144a127b', 'request_id': 'req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.595644 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ee1f0ec9db49d7aa043d61144a127b', 'request_id': 'req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.603964 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] The token cache is being invalidate because project b9ee1f0ec9db49d7aa043d61144a127b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:35.604255 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.605009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.606676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1427/2828] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:35 2022] DELETE /identity/v3/projects/b9ee1f0ec9db49d7aa043d61144a127b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:35.610740 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:35.612181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:35.625439 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefbbf4-e1d5-4f47-a891-a8556a55bdc8 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:35.683152 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:35.684025 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:35.684318 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:35.684633 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] PATH_INFO: `/v3/users/cfda3a1d37594730b09eaf10e00162e1` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:35.685830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfda3a1d37594730b09eaf10e00162e1)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:35.687801 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:35.808976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:35.821442 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfda3a1d37594730b09eaf10e00162e1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.833405 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfda3a1d37594730b09eaf10e00162e1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.834119 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfda3a1d37594730b09eaf10e00162e1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.834742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfda3a1d37594730b09eaf10e00162e1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.887028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-f788c83b-3e63-456b-87ec-ba14afe3cc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfda3a1d37594730b09eaf10e00162e1'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:35.900063 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1402/2829] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:35 2022] DELETE /identity/v3/users/cfda3a1d37594730b09eaf10e00162e1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:36.300542 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.303156 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:36.316562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47ca1-67e6-4d62-8e38-beefb0efe8d3 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.336798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:36.377661 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.378527 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.378817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.379100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] PATH_INFO: `/v3/projects/b9732351322047e4a25fa9643ca8d463` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.381554 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9732351322047e4a25fa9643ca8d463)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:36.383548 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:36.493394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9732351322047e4a25fa9643ca8d463', 'request_id': 'req-9ca9140a-d04c-44af-b0ab-358f0227f925'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:36.560930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9732351322047e4a25fa9643ca8d463', 'request_id': 'req-9ca9140a-d04c-44af-b0ab-358f0227f925'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:36.567863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9732351322047e4a25fa9643ca8d463', 'request_id': 'req-9ca9140a-d04c-44af-b0ab-358f0227f925'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:36.578487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] The token cache is being invalidate because project b9732351322047e4a25fa9643ca8d463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:36.578777 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:36.579416 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-9ca9140a-d04c-44af-b0ab-358f0227f925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:36.581036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1428/2830] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:36 2022] DELETE /identity/v3/projects/b9732351322047e4a25fa9643ca8d463 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:36.587252 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.587656 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.587994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.608919 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:36.610129 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:36.670584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1403/2831] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:36.679688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.679980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.680261 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.698410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:36.699598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:36.707344 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1429/2832] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:36.711481 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.721089 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65261-ae3e-42c5-b17b-18060955a741 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.726498 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.727151 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.727440 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.727721 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.728449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:36.729050 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:36.730646 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:36.743192 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1404/2833] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:36.747570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.756681 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f677a-7293-4d03-919f-27ed3fb1ee27 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.761382 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.762024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.762308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.762584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.763272 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:36.765318 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:36.843414 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1430/2834] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:36 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:36.847712 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.858609 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec03a8e-0165-4e33-8352-654d481b6429 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.914660 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.915324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.915612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.915892 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.916631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:36.918540 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.019452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1405/2835] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:36 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:37.024048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.034485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334637-63e4-4eb1-9006-f7b9b1a9101d admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.039984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.040653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.040947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.041228 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.041963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.043544 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.053963 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1431/2836] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:37.057960 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.068108 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369c744-40ec-4f0d-a340-f33a15cb1dac admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.072652 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.073308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.073593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.073870 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.074587 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.076159 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3750e-adcf-4de1-a8d0-c65971f178c6 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.086629 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1406/2837] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:37.090691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.101395 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b44a1-65b3-4cef-91cf-a3c673b2c4be admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.106231 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.107163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.107452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.107732 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] PATH_INFO: `/v3/projects/c03d854fe1ce4cf986e154124ec75a6c/users/879d31604b0b482598d2a02cebcf9152/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.122048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03d854fe1ce4cf986e154124ec75a6c, user_id=879d31604b0b482598d2a02cebcf9152, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.124715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.213950 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1432/2838] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:37 2022] PUT /identity/v3/projects/c03d854fe1ce4cf986e154124ec75a6c/users/879d31604b0b482598d2a02cebcf9152/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:41:37.226872 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.227168 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.229854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.255298 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] MFA Rules not processed for user `879d31604b0b482598d2a02cebcf9152`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:37.256575 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:37.260635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.322110 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1407/2839] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:37.326926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.375882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.390103 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05172a11-721a-491c-a351-094f71b30bcd admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.394903 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.396310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.396582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.396899 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.397584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.399487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.461191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1433/2840] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:37 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:37.465404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.477048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea0a03-3cd4-4678-b4a9-44a2212b6714 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.537779 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.538483 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.538896 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.539184 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.539875 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.541842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.608688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1408/2841] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:37 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:37.612420 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.624029 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de851f4-7223-45ae-a2f4-f5c1dd3b5033 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.628790 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.630343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.630689 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.630978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.631699 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.633316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.644151 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1434/2842] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:37.649645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.659773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582ea5-f31b-4baa-b2b5-6619d48fe37e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.664743 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.665632 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.665923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.666208 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] PATH_INFO: `/v3/projects/2b14ede3627142dda2b848d09a743ec3/users/c8f59e4c16074a42bb70d6d946f2f226/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.681895 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b14ede3627142dda2b848d09a743ec3, user_id=c8f59e4c16074a42bb70d6d946f2f226, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.684786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.750233 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1409/2843] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:37 2022] PUT /identity/v3/projects/2b14ede3627142dda2b848d09a743ec3/users/c8f59e4c16074a42bb70d6d946f2f226/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:37.754984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.764955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02378d-c279-49d1-8e5e-131b9ce9a117 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.822154 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812ebae-c873-4835-a034-65690517433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.822817 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ebae-c873-4835-a034-65690517433a admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.823101 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ebae-c873-4835-a034-65690517433a admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.823379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ebae-c873-4835-a034-65690517433a admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.824096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812ebae-c873-4835-a034-65690517433a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.825692 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812ebae-c873-4835-a034-65690517433a admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.835522 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1435/2844] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:37.839823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.850112 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8220db-9189-488b-9ef5-8310d1ba4ba9 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.854938 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.855809 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.856092 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.856367 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] PATH_INFO: `/v3/projects/2b14ede3627142dda2b848d09a743ec3/users/c8f59e4c16074a42bb70d6d946f2f226/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.858323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b14ede3627142dda2b848d09a743ec3, user_id=c8f59e4c16074a42bb70d6d946f2f226, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.861062 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.872041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1410/2845] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:37 2022] PUT /identity/v3/projects/2b14ede3627142dda2b848d09a743ec3/users/c8f59e4c16074a42bb70d6d946f2f226/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:37.882695 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.882993 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.883319 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.909313 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] MFA Rules not processed for user `c8f59e4c16074a42bb70d6d946f2f226`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:37.910659 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:37.979409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1436/2846] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:37.991674 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.993384 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:38.050048 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1730-65ec-4565-8219-3dac825ce235 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.054280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.054913 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.055198 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.055476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.064402 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.065953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.071598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.076178 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1411/2847] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:38.263911 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:38.273844 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09e8b4-3753-4ed0-b73b-fc762319e684 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.277360 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.278000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.278293 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.278570 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.320376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.336188 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.337811 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758520b-585c-4ee8-831d-b27a26da737b service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.346579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1437/2848] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:44.341825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:44.405954 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364d617-c380-4da6-9d09-668ab640d4bb service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:44.410453 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:44.411329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:44.411619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:44.412064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] PATH_INFO: `/v3/users/879d31604b0b482598d2a02cebcf9152` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:44.413336 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879d31604b0b482598d2a02cebcf9152)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:44.415291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:44.626843 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879d31604b0b482598d2a02cebcf9152'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:44.644810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879d31604b0b482598d2a02cebcf9152'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:44.645523 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879d31604b0b482598d2a02cebcf9152'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:44.646125 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879d31604b0b482598d2a02cebcf9152'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:44.721275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879d31604b0b482598d2a02cebcf9152'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:44.734687 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1412/2849] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:44 2022] DELETE /identity/v3/users/879d31604b0b482598d2a02cebcf9152 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:44.739237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:44.739729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:44.739836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:44.757401 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:44.758580 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:44.823135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1438/2850] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:44.832839 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:44.835064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:44.891323 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d1306-420d-42e9-a774-116151fea210 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:44.894800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:44.895443 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:44.895732 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:44.896012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:44.905598 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:44.907041 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:44.916648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1413/2851] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:45.311397 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:45.312887 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:45.328193 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce01aee-9ea5-4a16-b02b-d978f85c71e6 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:45.334053 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:45.335128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.335412 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.335691 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] PATH_INFO: `/v3/projects/c03d854fe1ce4cf986e154124ec75a6c` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.340505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03d854fe1ce4cf986e154124ec75a6c)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:45.340505 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:45.441960 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03d854fe1ce4cf986e154124ec75a6c', 'request_id': 'req-725e7485-e367-49b5-b7bd-d1e9a26bbb80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.504249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03d854fe1ce4cf986e154124ec75a6c', 'request_id': 'req-725e7485-e367-49b5-b7bd-d1e9a26bbb80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.511620 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03d854fe1ce4cf986e154124ec75a6c', 'request_id': 'req-725e7485-e367-49b5-b7bd-d1e9a26bbb80'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.522075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] The token cache is being invalidate because project c03d854fe1ce4cf986e154124ec75a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:45.522348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.522995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.524572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1439/2852] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:45 2022] DELETE /identity/v3/projects/c03d854fe1ce4cf986e154124ec75a6c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:45.528578 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:45.538865 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9152d-b259-4e24-b200-0332ae32ec11 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:45.557619 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:45.595827 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:45.596734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.601572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.601572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] PATH_INFO: `/v3/users/c8f59e4c16074a42bb70d6d946f2f226` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.601572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f59e4c16074a42bb70d6d946f2f226)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:45.601572 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:45.798137 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f59e4c16074a42bb70d6d946f2f226'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.810790 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f59e4c16074a42bb70d6d946f2f226'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.811450 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f59e4c16074a42bb70d6d946f2f226'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.812079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f59e4c16074a42bb70d6d946f2f226'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.875621 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-13cba527-67e2-4ddb-8458-3dfe987d5e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f59e4c16074a42bb70d6d946f2f226'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:45.888140 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1414/2853] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:45 2022] DELETE /identity/v3/users/c8f59e4c16074a42bb70d6d946f2f226 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:46.299958 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.301524 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:46.314798 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e7485-e367-49b5-b7bd-d1e9a26bbb80 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.374754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.375612 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.375898 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.376175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] PATH_INFO: `/v3/projects/2b14ede3627142dda2b848d09a743ec3` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.377411 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b14ede3627142dda2b848d09a743ec3)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.382404 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.386437 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.501390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b14ede3627142dda2b848d09a743ec3', 'request_id': 'req-2e213882-1f5d-46c6-aee6-af6a15c0e987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:46.556036 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b14ede3627142dda2b848d09a743ec3', 'request_id': 'req-2e213882-1f5d-46c6-aee6-af6a15c0e987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:46.562468 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b14ede3627142dda2b848d09a743ec3', 'request_id': 'req-2e213882-1f5d-46c6-aee6-af6a15c0e987'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:46.573323 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] The token cache is being invalidate because project 2b14ede3627142dda2b848d09a743ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:46.573618 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:46.574276 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2e213882-1f5d-46c6-aee6-af6a15c0e987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:46.576041 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1440/2854] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:46 2022] DELETE /identity/v3/projects/2b14ede3627142dda2b848d09a743ec3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:46.581377 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.581863 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.591889 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.601828 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:46.603039 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:46.662308 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1415/2855] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:46.670646 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.670941 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.671226 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.689711 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:46.690897 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:46.699723 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1441/2856] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:46.703903 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.713931 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072cd5-6d3a-46c5-ada1-1d97bf8668e6 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.718529 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.719185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.719475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.719760 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] PATH_INFO: `/v3/domains` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.720514 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:46.720861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.722476 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.734408 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1416/2857] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:46.738635 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.748482 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab181121-58d4-4e50-8bf8-812266d8fbc9 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.753100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.753740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.754024 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.754304 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.754994 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.756895 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.858572 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1442/2858] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:46 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:41:46.861783 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.873026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355da7-a466-4292-978e-e32b5910ecca admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.900091 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.930803 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.931527 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.931815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.932100 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.932818 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.934739 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.002713 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1417/2859] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:46 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:41:47.007668 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.018114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe5996-60ad-4882-9973-8232e4c50b19 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.023684 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.024534 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.026841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.026841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.026841 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.027462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.037915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1443/2860] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:47.042406 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.052157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc8dbf-bc00-4f4f-8098-826d68a1c53e admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.057703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.058357 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.058640 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.058916 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.059635 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.061268 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9234f-1c88-485b-8f6d-203f87e09405 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.071815 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1418/2861] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:41:47.075773 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.086657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59829-8609-4d89-8ea9-0c421446f7b4 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.091379 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.092258 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.092545 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.092860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] PATH_INFO: `/v3/projects/cb352b80cdb64a88b998c66742d20ec6/users/bea3fcc0dd8a44659cd207cf8bd55304/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.108000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb352b80cdb64a88b998c66742d20ec6, user_id=bea3fcc0dd8a44659cd207cf8bd55304, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.110755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.184133 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1444/2862] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:47 2022] PUT /identity/v3/projects/cb352b80cdb64a88b998c66742d20ec6/users/bea3fcc0dd8a44659cd207cf8bd55304/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:41:47.201808 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.202105 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.202393 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.230570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] MFA Rules not processed for user `bea3fcc0dd8a44659cd207cf8bd55304`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:47.231795 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:47.296016 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1419/2863] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:47.300705 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.363040 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca14049-7714-4237-b321-9a65659f6dad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.368347 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.369042 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.369328 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.369609 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.370308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.372209 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.454368 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1445/2864] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:47 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:47.458373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.469124 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb2df-b790-451a-831b-611efbb0f2ab None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.526003 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.526685 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.526976 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.527257 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.527957 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.529908 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.612506 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1420/2865] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:47 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:47.617234 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.627674 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336d306-b9f5-402c-841e-1a90712f23e7 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.633058 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.633716 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.633996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.634301 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.635026 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.636626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.647220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1446/2866] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:47.652136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.662466 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62343-27a7-4b94-bedf-666afa7e2e88 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.668429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.669161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.669449 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.669731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.670462 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.672064 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fc87d-b445-4b05-b1db-ebbd9803e7e3 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.682679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1421/2867] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:47.686961 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.693376 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:47.697192 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39274-8390-41ca-b5bc-b4738a89a7e9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.701828 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.705625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.705625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.705625 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] PATH_INFO: `/v3/projects/780c6044ccc442e299f2368dd6fd2c8f/users/b7d8af3a793946b98b33a8d8cdf499b7/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.718697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780c6044ccc442e299f2368dd6fd2c8f, user_id=b7d8af3a793946b98b33a8d8cdf499b7, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.721431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.784755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1447/2868] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:47 2022] PUT /identity/v3/projects/780c6044ccc442e299f2368dd6fd2c8f/users/b7d8af3a793946b98b33a8d8cdf499b7/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:47.796309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.796600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.796956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.823639 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] MFA Rules not processed for user `b7d8af3a793946b98b33a8d8cdf499b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:47.824866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:47.828817 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:47.889544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1422/2869] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:47.894206 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.957859 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3aa3-30f2-4887-88f1-3ba0757edb16 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.963298 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.963962 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.964254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.964533 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.965266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.967175 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.043064 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1448/2870] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:48.047303 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.058622 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719c6a-d84b-40ef-8250-c254aebab0a5 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.121472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.122164 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.122452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.122734 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] PATH_INFO: `/v3/users` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.123435 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.125473 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.196073 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1423/2871] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:41:48 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:48.200100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.210824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c90c9-aa8a-4bb6-a04b-457f7eeb6c17 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.215436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.216100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.216384 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.216685 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.217409 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.218995 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.230789 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1449/2872] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:48.235081 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.245569 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88018c69-7a21-483c-96f3-26693164a4ea admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.250395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.251277 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.251568 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.251854 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] PATH_INFO: `/v3/projects/283e79964b58438abb5eed520302fad2/users/230cffe47ad74a388dc64a25638170f6/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.267153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=283e79964b58438abb5eed520302fad2, user_id=230cffe47ad74a388dc64a25638170f6, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.269873 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.378230 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1424/2873] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:48 2022] PUT /identity/v3/projects/283e79964b58438abb5eed520302fad2/users/230cffe47ad74a388dc64a25638170f6/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:48.382363 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.392219 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0c625-994a-448f-8187-3297b1f49948 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.457670 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.458573 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.459009 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.459434 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.460585 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.463235 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30a90-0ee4-4727-980d-2181c39f4408 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.479000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1450/2874] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:41:48.483245 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.495253 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d63aa-9bee-4740-988c-7eb23d9789cf admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.499825 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.500738 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.501027 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.501309 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] PATH_INFO: `/v3/projects/283e79964b58438abb5eed520302fad2/users/230cffe47ad74a388dc64a25638170f6/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.503305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] RBAC: Authorizing `identity:create_grant(project_id=283e79964b58438abb5eed520302fad2, user_id=230cffe47ad74a388dc64a25638170f6, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.505977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.516370 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1425/2875] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:41:48 2022] PUT /identity/v3/projects/283e79964b58438abb5eed520302fad2/users/230cffe47ad74a388dc64a25638170f6/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:48.527634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.527926 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.528208 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.556055 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] MFA Rules not processed for user `230cffe47ad74a388dc64a25638170f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:48.558096 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:48.597802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:48.627743 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1451/2876] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:41:48.639279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:48.644250 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:48.705593 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:48.708101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b8d49-44eb-470b-9266-48384f8130db admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:48.711797 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:48.712445 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:48.713035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:48.713035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:48.771515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:48.773244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:48.782956 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1426/2877] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:51.727403 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.738707 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5d52a-cb82-45c2-a82c-36f457eb0051 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.743356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.744000 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.745148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.745148 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.808602 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.810085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.820162 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1452/2878] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:53.090952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:53.099631 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1356-9253-4eaf-b19f-7656f0067b2a service cinder] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:53.104202 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d25014e11e4765b66fc04586547473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:53.104866 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:53.105173 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:53.105429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:53.114475 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:53.115910 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d58ba5-174b-4a90-9b52-f85b323eaf64 service cinder] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:53.126246 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1427/2879] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:57.767061 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:57.833143 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41f79-8cf9-4e2c-8bb9-57f3833196d3 service cinder] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:57.838582 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:57.839458 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:57.839744 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:57.840019 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] PATH_INFO: `/v3/users/bea3fcc0dd8a44659cd207cf8bd55304` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:57.841249 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea3fcc0dd8a44659cd207cf8bd55304)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:57.843163 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:57.993201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea3fcc0dd8a44659cd207cf8bd55304'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:57.993806 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea3fcc0dd8a44659cd207cf8bd55304'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.001048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea3fcc0dd8a44659cd207cf8bd55304'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.001701 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea3fcc0dd8a44659cd207cf8bd55304'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.081410 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea3fcc0dd8a44659cd207cf8bd55304'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.092191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:58.099760 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1453/2880] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:57 2022] DELETE /identity/v3/users/bea3fcc0dd8a44659cd207cf8bd55304 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:58.105206 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:58.105675 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:58.109005 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:58.123205 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:58.124416 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:58.184310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1428/2881] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:41:58.194090 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:58.197028 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:58.255408 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45739-d542-4d63-bf0f-3ecb2c8d6d40 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:58.259244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:58.259891 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:58.260182 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:58.260471 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:58.269474 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:58.270909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:58.280671 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1454/2882] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:41:58.705778 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:58.707269 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:58.719411 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51561be7-b341-46d6-a047-207ee62e6498 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:58.724068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:58.725019 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:58.725315 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:58.725634 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] PATH_INFO: `/v3/projects/cb352b80cdb64a88b998c66742d20ec6` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:58.726947 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb352b80cdb64a88b998c66742d20ec6)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:58.729220 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:58.847767 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb352b80cdb64a88b998c66742d20ec6', 'request_id': 'req-8b9371b6-d754-4de8-981e-56b90c539c90'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.854890 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb352b80cdb64a88b998c66742d20ec6', 'request_id': 'req-8b9371b6-d754-4de8-981e-56b90c539c90'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.860600 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb352b80cdb64a88b998c66742d20ec6', 'request_id': 'req-8b9371b6-d754-4de8-981e-56b90c539c90'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.933012 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] The token cache is being invalidate because project cb352b80cdb64a88b998c66742d20ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:41:58.933356 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.933994 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:58.935577 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1429/2883] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:58 2022] DELETE /identity/v3/projects/cb352b80cdb64a88b998c66742d20ec6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:58.939583 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:58.950031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94458-11cc-4e5f-bd5d-ca25829687b4 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.017221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.018100 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.018392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.018683 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] PATH_INFO: `/v3/users/b7d8af3a793946b98b33a8d8cdf499b7` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.019871 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d8af3a793946b98b33a8d8cdf499b7)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.021826 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.233099 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d8af3a793946b98b33a8d8cdf499b7'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.233794 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d8af3a793946b98b33a8d8cdf499b7'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.241508 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d8af3a793946b98b33a8d8cdf499b7'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.242179 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d8af3a793946b98b33a8d8cdf499b7'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.322308 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d8af3a793946b98b33a8d8cdf499b7'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.341753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1455/2884] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:41:58 2022] DELETE /identity/v3/users/b7d8af3a793946b98b33a8d8cdf499b7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:59.751582 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.753116 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:59.767511 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9371b6-d754-4de8-981e-56b90c539c90 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.782561 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:59.831918 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.832832 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.833122 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.833404 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] PATH_INFO: `/v3/projects/780c6044ccc442e299f2368dd6fd2c8f` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.834601 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780c6044ccc442e299f2368dd6fd2c8f)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.837693 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.956599 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780c6044ccc442e299f2368dd6fd2c8f', 'request_id': 'req-e72866ad-4848-4160-bc51-85843b4c0732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.963493 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780c6044ccc442e299f2368dd6fd2c8f', 'request_id': 'req-e72866ad-4848-4160-bc51-85843b4c0732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:41:59.968915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780c6044ccc442e299f2368dd6fd2c8f', 'request_id': 'req-e72866ad-4848-4160-bc51-85843b4c0732'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.064485 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] The token cache is being invalidate because project 780c6044ccc442e299f2368dd6fd2c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:42:00.064810 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.065454 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.067030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1430/2885] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:41:59 2022] DELETE /identity/v3/projects/780c6044ccc442e299f2368dd6fd2c8f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:42:00.071735 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.073201 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:00.086001 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3659-b6a6-4543-8a96-8842d97cc05f admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.098123 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.143503 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.144754 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.145227 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.145857 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] PATH_INFO: `/v3/users/230cffe47ad74a388dc64a25638170f6` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.147146 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230cffe47ad74a388dc64a25638170f6)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.149338 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.335181 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230cffe47ad74a388dc64a25638170f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.335762 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230cffe47ad74a388dc64a25638170f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.342751 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230cffe47ad74a388dc64a25638170f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.343387 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230cffe47ad74a388dc64a25638170f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.401270 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-2809c212-33d8-47ea-adc7-b9ed04c57507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230cffe47ad74a388dc64a25638170f6'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:00.419291 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1456/2886] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:42:00 2022] DELETE /identity/v3/users/230cffe47ad74a388dc64a25638170f6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:42:00.873097 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.874626 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:00.890842 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72866ad-4848-4160-bc51-85843b4c0732 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.950552 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.951428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.951720 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.952002 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] PATH_INFO: `/v3/projects/283e79964b58438abb5eed520302fad2` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.953226 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=283e79964b58438abb5eed520302fad2)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.955190 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.062628 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:01.065243 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283e79964b58438abb5eed520302fad2', 'request_id': 'req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:01.072009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283e79964b58438abb5eed520302fad2', 'request_id': 'req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:01.077352 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283e79964b58438abb5eed520302fad2', 'request_id': 'req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:01.150491 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] The token cache is being invalidate because project 283e79964b58438abb5eed520302fad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:42:01.150706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:01.151373 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-4d54ebd5-2f94-45f9-8a0d-b49f18ecda5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:42:01.152962 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1431/2887] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:42:00 2022] DELETE /identity/v3/projects/283e79964b58438abb5eed520302fad2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:42:01.159221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.159709 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.159802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.177715 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:01.178915 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:01.245157 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1457/2888] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:01.253251 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.253544 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.253850 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.273101 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:01.274425 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:01.282365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1432/2889] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:42:01.286647 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.297390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac11b8a-5477-42bb-92c7-9077eb56241a None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.302085 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.302741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.303035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.303311 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] PATH_INFO: `/v3/domains` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.304039 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:01.304352 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.306610 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.317972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1458/2890] 10.222.0.57 () {58 vars in 1152 bytes} [Wed May 25 15:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:42:01.322753 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.332078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e825e-0398-4b9b-a79a-d242241b139e None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.337126 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.337780 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.338072 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.338355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.339077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.341051 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.432697 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1433/2891] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:42:01 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:01.436469 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.446753 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693e8e-96dc-4560-8333-ce9ff1483465 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.465248 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:01.502803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.503464 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.503747 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.504021 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.504741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.506947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.607972 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1459/2892] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:42:01 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:01.612079 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.623310 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f93d-17eb-4a2a-a35b-67fdb86a1c40 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.627904 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.628846 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.629136 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.629423 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.630153 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.631763 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.643035 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1434/2893] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:42:01.647184 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.657721 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d43cca-54de-4aed-b977-60eaea2e755e admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.662275 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.662922 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.666269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.666269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] PATH_INFO: `/v3/roles` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.666269 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.667320 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f693-da26-49b5-bbbe-125f2d64326d admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.677362 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1460/2894] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:42:01.681755 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.691856 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd11b9-e27a-4206-8640-ddafdb65afdb admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.696458 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.697374 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] REQUEST_METHOD: `PUT` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.697667 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.697951 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] PATH_INFO: `/v3/projects/d176393f812c43de9299c14e1b3982fe/users/ba511af0a4b14f5492cd33decee9db8b/roles/e2b78b59f5d045dfbb1c6057b955be64` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.712811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d176393f812c43de9299c14e1b3982fe, user_id=ba511af0a4b14f5492cd33decee9db8b, role_id=e2b78b59f5d045dfbb1c6057b955be64)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.715464 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.797295 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1435/2895] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:42:01 2022] PUT /identity/v3/projects/d176393f812c43de9299c14e1b3982fe/users/ba511af0a4b14f5492cd33decee9db8b/roles/e2b78b59f5d045dfbb1c6057b955be64 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:42:01.802642 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d71368-a827-48ad-97b1-f0373a6b4d90 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.802943 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d71368-a827-48ad-97b1-f0373a6b4d90 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.803260 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d71368-a827-48ad-97b1-f0373a6b4d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.822766 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-18d71368-a827-48ad-97b1-f0373a6b4d90 None None] MFA Rules not processed for user `1f293424a3574c11b9a214ef1e03ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:01.827566 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-18d71368-a827-48ad-97b1-f0373a6b4d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:01.897769 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1461/2896] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:01.908044 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.909936 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:01.967492 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace74cf-c9c5-435d-8b52-d929d23e240a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.972078 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.972766 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.973060 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.973342 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.983420 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.984902 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.994814 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1436/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:42:06.861396 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:06.861947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:06.862305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:06.893755 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] MFA Rules not processed for user `ba511af0a4b14f5492cd33decee9db8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:06.894984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:06.964810 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1462/2898] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:06.969329 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:06.980433 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228eea5-69c9-4285-b3e2-3f272541a975 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:06.985213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:06.985991 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:06.986350 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:06.986703 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] PATH_INFO: `/v3/projects` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:06.987472 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:06.989657 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.072725 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1437/2899] 10.222.0.57 () {60 vars in 1152 bytes} [Wed May 25 15:42:06 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:07.076588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:07.089487 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb16da-165a-4660-a3b4-83fa1a78672c None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:07.121060 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:07.150718 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:07.154283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:07.154283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:07.154283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:07.154283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:07.154930 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.234792 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1463/2900] 10.222.0.57 () {60 vars in 1143 bytes} [Wed May 25 15:42:07 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:07.237149 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:07.250806 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9cd3-577c-420c-a722-0695ae1abefb admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:07.257155 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:07.258180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:07.258570 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:07.258946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:07.259688 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:07.261372 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.273813 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1438/2901] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:42:07.279286 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:07.290734 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a25f-a7ee-4871-b457-f03a4d1b2bd9 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:07.295726 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:07.296634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:07.297027 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:07.297316 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] PATH_INFO: `/v3/projects/805e1257beac40afa863d2ed67444024/users/e7ce6ea521fb4906ac7f96b5af64f08c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:07.313888 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e1257beac40afa863d2ed67444024, user_id=e7ce6ea521fb4906ac7f96b5af64f08c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:07.316517 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.413462 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1464/2902] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:42:07 2022] PUT /identity/v3/projects/805e1257beac40afa863d2ed67444024/users/e7ce6ea521fb4906ac7f96b5af64f08c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:42:07.418030 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:07.428536 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454100-fc56-4c61-b4b5-cd1dae41af77 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:07.471636 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:07.495985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:07.496915 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:07.497174 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:07.497465 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] PATH_INFO: `/v3/roles` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:07.498209 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:07.499826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6e54-4875-4479-a285-d91eb8ada550 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.512279 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1439/2903] 10.222.0.57 () {58 vars in 1121 bytes} [Wed May 25 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:42:07.516200 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:07.527506 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3989ed-3fdd-42a0-abb9-b3884a216687 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:07.532418 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:07.533676 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:07.534048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:07.534415 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] PATH_INFO: `/v3/projects/805e1257beac40afa863d2ed67444024/users/e7ce6ea521fb4906ac7f96b5af64f08c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:07.536494 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e1257beac40afa863d2ed67444024, user_id=e7ce6ea521fb4906ac7f96b5af64f08c, role_id=6fb1abd2c71e4a9daf0ba0b42d62b46f)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:07.539945 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:07.551266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1465/2904] 10.222.0.57 () {60 vars in 1482 bytes} [Wed May 25 15:42:07 2022] PUT /identity/v3/projects/805e1257beac40afa863d2ed67444024/users/e7ce6ea521fb4906ac7f96b5af64f08c/roles/6fb1abd2c71e4a9daf0ba0b42d62b46f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:42:13.157798 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d395f8-9a6f-4ee2-8b19-679ab2d0d5ae None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:13.158324 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d395f8-9a6f-4ee2-8b19-679ab2d0d5ae None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:13.158784 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d395f8-9a6f-4ee2-8b19-679ab2d0d5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:13.189852 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-b7d395f8-9a6f-4ee2-8b19-679ab2d0d5ae None None] MFA Rules not processed for user `e7ce6ea521fb4906ac7f96b5af64f08c`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:13.192759 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-b7d395f8-9a6f-4ee2-8b19-679ab2d0d5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:13.269409 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1440/2905] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:13.282077 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:13.283863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:13.347431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f29df-fb6e-476c-b424-7d99c4b38f45 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:13.351025 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:13.352364 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:13.352682 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:13.352966 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:13.412584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:13.414586 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:13.423509 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1466/2906] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:42:13.665244 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706789-9ce2-4fff-80c5-9b6e5a800e07 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:13.665539 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706789-9ce2-4fff-80c5-9b6e5a800e07 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:13.665826 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706789-9ce2-4fff-80c5-9b6e5a800e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:13.728121 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-01706789-9ce2-4fff-80c5-9b6e5a800e07 None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:13.729648 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-01706789-9ce2-4fff-80c5-9b6e5a800e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:13.794748 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1441/2907] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:13.933436 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:13.935114 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:13.993577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:14.045540 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7dcf-34a1-4941-bf27-62f9413e034a service glance] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:14.050679 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:14.051340 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:14.051632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:14.051912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:14.061990 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:14.063653 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:14.074283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1467/2908] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 15:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:42:23.791610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:24.070465 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=24 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:25.348291 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:25.348823 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:25.348926 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:25.366679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] MFA Rules not processed for user `ba511af0a4b14f5492cd33decee9db8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:25.367897 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:25.375679 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1442/2909] 10.222.0.57 () {58 vars in 957 bytes} [Wed May 25 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:25.413851 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:25.424392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af7d3-38f4-4ff3-8ebb-ac6d98682ec0 service swift] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:25.427343 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9548a1d963a644559c769715d0d58c9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:25.427984 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:25.428271 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:25.428553 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:25.430431 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:25.504107 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:25.505481 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bc606-372c-4003-8048-d524f1084374 service glance] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:25.516909 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1468/2910] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:42:25.743505 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:25.797512 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027ec65-d858-4a43-8bb1-9188beed8107 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:25.801023 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:25.801663 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:25.801953 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:25.802229 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:25.804077 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:25.814068 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:25.817428 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:25.824737 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1443/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:42:30.009142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:30.009634 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:30.009780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:30.027430 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:30.028562 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:30.035818 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1469/2912] 10.222.0.57 () {58 vars in 1009 bytes} [Wed May 25 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:42:30.048692 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:30.062684 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f696b-03dc-48b1-89ec-e5b3a5daff1b service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:30.067917 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:30.072270 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:30.072576 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:30.072900 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:30.081997 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:30.083592 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d778-840d-4e1a-aa92-ba7f88f4b8ad service swift] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:30.093620 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1444/2913] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 15:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:42:40.021892 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=37 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:40.089785 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=35 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:44.821791 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:44.823373 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:44.842626 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8781a-bd2b-405e-bb25-c66f57eb69a5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:44.848135 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:44.848829 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:44.849171 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:44.849392 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:44.851178 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:44.864279 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:44.865933 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33f39-f6df-4a08-bc77-6e2a648c1c5a service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:44.878241 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1470/2914] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:42:54.873947 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=6 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:43:03.032451 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5768-e1f7-4b66-b4e1-4dfa0b56142c None None] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.036391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5768-e1f7-4b66-b4e1-4dfa0b56142c None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.036391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5768-e1f7-4b66-b4e1-4dfa0b56142c None None] PATH_INFO: `/` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.036391 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1445/2915] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:43:03.041283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50adca-ea09-403e-9feb-6fd8f823e923 None None] REQUEST_METHOD: `POST` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.041283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50adca-ea09-403e-9feb-6fd8f823e923 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.042351 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50adca-ea09-403e-9feb-6fd8f823e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.081330 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.auth.core [None req-cd50adca-ea09-403e-9feb-6fd8f823e923 None None] MFA Rules not processed for user `c761026c0e3e466d9f485c5dd6b6acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:43:03.082632 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-cd50adca-ea09-403e-9feb-6fd8f823e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:43:03.089402 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1471/2916] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:43:03.101210 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5768-e1f7-4b66-b4e1-4dfa0b56142c None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:43:03.112457 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5768-e1f7-4b66-b4e1-4dfa0b56142c None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:43:03.115985 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:43:03.116645 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.116940 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.117228 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.124885 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:43:03.126314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf0a39-0de5-4f04-9984-0cb221633fa1 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:43:03.134036 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1446/2917] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:43:03.216369 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361151-d302-4325-b802-6e0dd5c3b0a5 None None] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.216697 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361151-d302-4325-b802-6e0dd5c3b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.216978 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361151-d302-4325-b802-6e0dd5c3b0a5 None None] PATH_INFO: `/` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.218356 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1472/2918] 10.222.0.57 () {54 vars in 921 bytes} [Wed May 25 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:43:03.224026 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.224327 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.224637 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.262197 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] MFA Rules not processed for user `c0b8fde7b5024cf5b39899fae30a463e`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:43:03.263400 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:43:03.273009 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1447/2919] 10.222.0.57 () {58 vars in 1018 bytes} [Wed May 25 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:43:03.284044 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361151-d302-4325-b802-6e0dd5c3b0a5 None None] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:43:03.295779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361151-d302-4325-b802-6e0dd5c3b0a5 None None] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:43:03.299322 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:43:03.299955 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:03.300244 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:03.300521 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:03.310864 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:43:03.312310 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:43:03.323485 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1473/2920] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:43:07.897194 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:43:07.906757 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3f94-4556-44b8-a7d3-7537f7d21677 None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:43:07.910343 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:43:07.914437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:07.914437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:07.914437 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:07.921161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:43:07.922604 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:43:07.932914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1448/2921] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:43:13.318541 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=15 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:43:17.927840 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=21 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:43:32.050056 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:43:32.051729 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:43:32.144498 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270b46-6859-41d5-a630-b5fe48936dad service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:43:32.149523 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:43:32.150167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:43:32.150453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:43:32.150740 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:43:32.153288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:43:32.164837 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:43:32.166398 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:43:32.176500 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1474/2922] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:43:42.172220 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=39 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:45:04.345058 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:04.346988 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:04.358486 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610e97-792a-4dfc-a783-7c1933f419e9 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:04.363317 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:04.363952 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:04.364241 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:04.364526 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:04.366313 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:04.432255 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:04.433706 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:04.443478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1449/2923] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:45:05.544359 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:05.545924 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:05.582873 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc92e37-4383-4936-97d9-0d6ea1c9adff service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:05.588917 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b8fde7b5024cf5b39899fae30a463e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:05.592237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:05.592237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:05.592237 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:05.592493 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:05.606348 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:05.607949 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:05.620763 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1475/2924] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:45:05.946742 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:05.957468 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394b8a-cb71-46e6-8371-156739ecfc1b service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:05.961379 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:05.962157 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:05.962447 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:05.962731 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:05.964563 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:05.979769 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:05.981273 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:05.993488 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1450/2925] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:45:10.938741 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:10.959266 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c7f9-f3ae-491a-80e4-d44a9a50b36e service nova] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:10.962836 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c761026c0e3e466d9f485c5dd6b6acbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:10.963519 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:10.963803 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:10.964081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:10.965912 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:11.030390 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:11.031874 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:11.041516 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1476/2926] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:45:14.434584 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:14.436134 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:14.475557 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863d7c-c740-420a-8110-abe0b833cf22 service neutron] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:14.481115 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:14.481775 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:14.482180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:14.482470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:14.484301 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:14.497187 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:14.498861 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:14.509478 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1451/2927] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:45:17.772229 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:17.783868 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ed8d-f199-4e2a-b484-1e028ee57da5 service neutron] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:17.788925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:17.789824 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:17.790142 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:17.790422 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:17.792191 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:17.804588 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:17.806254 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:17.817394 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1477/2928] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:45:17.890841 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:17.894176 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:17.907118 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0abbd7-5eb4-4535-a045-231b4b641ae6 service placement] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:17.912419 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:17.913319 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:17.913610 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:17.913893 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] PATH_INFO: `/v3/users/dbfd103f83e147448bc11ab7bc5c4feb` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:17.915090 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfd103f83e147448bc11ab7bc5c4feb)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:17.917172 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:18.074326 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfd103f83e147448bc11ab7bc5c4feb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.086946 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfd103f83e147448bc11ab7bc5c4feb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.087612 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfd103f83e147448bc11ab7bc5c4feb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.088224 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfd103f83e147448bc11ab7bc5c4feb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.169276 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfd103f83e147448bc11ab7bc5c4feb'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.183429 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1452/2929] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:45:17 2022] DELETE /identity/v3/users/dbfd103f83e147448bc11ab7bc5c4feb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:45:18.439389 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:18.451452 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253e560-38b7-4f4b-8afe-985c3cfe85ac service placement] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:18.511110 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:18.512031 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:18.512326 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:18.512698 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] PATH_INFO: `/v3/projects/ee5c5ad7e2d34027a12bb91ed87a7f19` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:18.520263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5c5ad7e2d34027a12bb91ed87a7f19)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:18.520263 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:18.629876 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:45:18.633259 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5c5ad7e2d34027a12bb91ed87a7f19', 'request_id': 'req-56bb847f-c573-4d7a-9fd0-d2800fa7b376'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.689584 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5c5ad7e2d34027a12bb91ed87a7f19', 'request_id': 'req-56bb847f-c573-4d7a-9fd0-d2800fa7b376'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.696756 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5c5ad7e2d34027a12bb91ed87a7f19', 'request_id': 'req-56bb847f-c573-4d7a-9fd0-d2800fa7b376'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.708305 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] The token cache is being invalidate because project ee5c5ad7e2d34027a12bb91ed87a7f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:45:18.708598 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.709288 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.710863 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1478/2930] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:45:18 2022] DELETE /identity/v3/projects/ee5c5ad7e2d34027a12bb91ed87a7f19 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:45:18.714811 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:18.716238 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:18.730452 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131606-40b6-4bda-82d1-cbd52b3d546f admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:18.761729 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:45:18.789427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:18.790305 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:18.790596 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:18.790881 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] PATH_INFO: `/v3/users/d793cdca454c4eba845b6c8e85ad87ec` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:18.792069 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d793cdca454c4eba845b6c8e85ad87ec)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:18.794028 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:18.960256 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd793cdca454c4eba845b6c8e85ad87ec'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.972470 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd793cdca454c4eba845b6c8e85ad87ec'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.973169 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd793cdca454c4eba845b6c8e85ad87ec'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:18.973800 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd793cdca454c4eba845b6c8e85ad87ec'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.026314 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-6bae77b1-c4a0-4dcc-b74d-990ad897b145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd793cdca454c4eba845b6c8e85ad87ec'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.039006 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1453/2931] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:45:18 2022] DELETE /identity/v3/users/d793cdca454c4eba845b6c8e85ad87ec => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:45:19.281190 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:19.282784 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:19.297128 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb847f-c573-4d7a-9fd0-d2800fa7b376 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:19.354438 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:19.355297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:19.355579 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:19.355854 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] PATH_INFO: `/v3/projects/f2d5abc910644a619e8fc8921e55dd60` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:19.357048 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d5abc910644a619e8fc8921e55dd60)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:19.359075 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:19.496996 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d5abc910644a619e8fc8921e55dd60', 'request_id': 'req-1804785e-3df1-41b3-bdc5-72d385340e55'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.566035 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d5abc910644a619e8fc8921e55dd60', 'request_id': 'req-1804785e-3df1-41b3-bdc5-72d385340e55'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.572956 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d5abc910644a619e8fc8921e55dd60', 'request_id': 'req-1804785e-3df1-41b3-bdc5-72d385340e55'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.584780 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] The token cache is being invalidate because project f2d5abc910644a619e8fc8921e55dd60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:45:19.585080 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.585746 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:45:19.587297 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1479/2932] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:45:19 2022] DELETE /identity/v3/projects/f2d5abc910644a619e8fc8921e55dd60 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:45:29.035427 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:45:29.580882 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:45:55.518710 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] REQUEST_METHOD: `POST` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:55.519185 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:55.519282 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:55.536977 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.auth.core [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] MFA Rules not processed for user `b0a904e037634da082f8997a47c78a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:45:55.538181 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:55.610395 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1454/2933] 10.222.0.57 () {58 vars in 967 bytes} [Wed May 25 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:45:55.651938 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:45:55.653365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:45:55.726776 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804785e-3df1-41b3-bdc5-72d385340e55 admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:45:55.732546 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea77596372484aaefd59eaad6403ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:45:55.733217 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] REQUEST_METHOD: `GET` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:45:55.733502 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:45:55.733779 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:45:55.741937 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:45:55.743578 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:45:55.751591 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1480/2934] 10.222.0.57 () {60 vars in 1384 bytes} [Wed May 25 15:45:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:46:03.874456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:46:03.875955 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:46:03.941705 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605bc90-0130-4d68-9385-8d3130afda0a None None] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:46:03.946284 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:46:03.947141 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:46:03.947456 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:46:03.947773 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] PATH_INFO: `/v3/users/ba511af0a4b14f5492cd33decee9db8b` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:46:03.948914 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba511af0a4b14f5492cd33decee9db8b)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:46:03.950824 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:46:04.132499 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba511af0a4b14f5492cd33decee9db8b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.145515 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba511af0a4b14f5492cd33decee9db8b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.146225 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba511af0a4b14f5492cd33decee9db8b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.147961 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba511af0a4b14f5492cd33decee9db8b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.193161 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba511af0a4b14f5492cd33decee9db8b'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.206235 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1455/2935] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:46:03 2022] DELETE /identity/v3/users/ba511af0a4b14f5492cd33decee9db8b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:46:04.439657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:46:04.451980 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba22a-81ae-45c7-bfb4-2678299122d1 service swift] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:46:04.508357 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:46:04.509925 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:46:04.510306 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:46:04.510633 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] PATH_INFO: `/v3/projects/d176393f812c43de9299c14e1b3982fe` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:46:04.511801 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d176393f812c43de9299c14e1b3982fe)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:46:04.513728 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:46:04.608713 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd176393f812c43de9299c14e1b3982fe', 'request_id': 'req-4fd1c780-585d-4be8-abaf-b7080fca32ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.696476 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd176393f812c43de9299c14e1b3982fe', 'request_id': 'req-4fd1c780-585d-4be8-abaf-b7080fca32ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.703802 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd176393f812c43de9299c14e1b3982fe', 'request_id': 'req-4fd1c780-585d-4be8-abaf-b7080fca32ad'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.714283 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] The token cache is being invalidate because project d176393f812c43de9299c14e1b3982fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:46:04.714577 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.715221 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:04.716902 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1481/2936] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:46:04 2022] DELETE /identity/v3/projects/d176393f812c43de9299c14e1b3982fe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:46:04.721199 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:46:04.722613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:46:04.738355 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6a58-dc7a-4049-95fc-a93750fdbf95 admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:46:04.759830 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:46:04.798728 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:46:04.799613 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:46:04.799901 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:46:04.800180 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] PATH_INFO: `/v3/users/e7ce6ea521fb4906ac7f96b5af64f08c` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:46:04.801399 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ce6ea521fb4906ac7f96b5af64f08c)` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:46:04.803365 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:46:05.002531 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ce6ea521fb4906ac7f96b5af64f08c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.014605 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ce6ea521fb4906ac7f96b5af64f08c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.015280 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ce6ea521fb4906ac7f96b5af64f08c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.015906 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ce6ea521fb4906ac7f96b5af64f08c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.076665 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.notifications [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ce6ea521fb4906ac7f96b5af64f08c'} {{(pid=86822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.089579 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1456/2937] 10.222.0.57 () {58 vars in 1223 bytes} [Wed May 25 15:46:04 2022] DELETE /identity/v3/users/e7ce6ea521fb4906ac7f96b5af64f08c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:46:05.342299 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Authenticating user token {{(pid=86823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:46:05.343708 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.fernet_utils [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:46:05.357453 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1c780-585d-4be8-abaf-b7080fca32ad admin admin] Validating token access rules against request {{(pid=86823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:46:05.381561 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:46:05.424477 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f293424a3574c11b9a214ef1e03ad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0561c92c72f64ee9b67355671c55b3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:46:05.425374 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:46:05.425657 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:46:05.425932 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] PATH_INFO: `/v3/projects/805e1257beac40afa863d2ed67444024` {{(pid=86823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:46:05.427161 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=805e1257beac40afa863d2ed67444024)` {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:46:05.429092 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] RBAC: Authorization granted {{(pid=86823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:46:05.540081 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805e1257beac40afa863d2ed67444024', 'request_id': 'req-92d7d694-1f25-4c16-9a45-7af3248a5b3c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.619860 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805e1257beac40afa863d2ed67444024', 'request_id': 'req-92d7d694-1f25-4c16-9a45-7af3248a5b3c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.626688 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805e1257beac40afa863d2ed67444024', 'request_id': 'req-92d7d694-1f25-4c16-9a45-7af3248a5b3c'} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.637884 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] The token cache is being invalidate because project 805e1257beac40afa863d2ed67444024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:46:05.638167 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.638797 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG keystone.notifications [None req-92d7d694-1f25-4c16-9a45-7af3248a5b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:46:05.640365 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: [pid: 86823|app: 0|req: 1482/2938] 10.222.0.57 () {58 vars in 1232 bytes} [Wed May 25 15:46:05 2022] DELETE /identity/v3/projects/805e1257beac40afa863d2ed67444024 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:46:15.085923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:46:15.634951 dv-cinder-787296-9-iscsi devstack@keystone.service[86823]: DEBUG dbcounter [-] [86823] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:48:35.992275 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Authenticating user token {{(pid=86822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:48:35.993704 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:48:36.061360 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6ebb4-4a96-4ddb-ac70-28a9095efc8a admin admin] Validating token access rules against request {{(pid=86822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:48:36.119043 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ab313dcca44094b7f445a9a46eb170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '450d5837471048de8055089f0c6bf7b6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:48:36.119691 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] REQUEST_METHOD: `GET` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:48:36.119980 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] SCRIPT_NAME: `/identity` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:48:36.120254 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:48:36.122056 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.fernet_utils [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:48:36.133213 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:48:36.134786 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e0e8b-e81c-4f45-a8df-23b26a54a69a service placement] RBAC: Authorization granted {{(pid=86822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:48:36.145300 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: [pid: 86822|app: 0|req: 1457/2939] 10.222.0.57 () {60 vars in 1365 bytes} [Wed May 25 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:48:46.140923 dv-cinder-787296-9-iscsi devstack@keystone.service[86822]: DEBUG dbcounter [-] [86822] Writing DB stats keystone:SELECT=58 {{(pid=86822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}